-- Logs begin at Wed 2022-02-16 13:23:54 UTC, end at Wed 2022-02-16 14:43:44 UTC. -- Feb 16 14:16:17.682268 dv-cinder-804735-16-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 16 14:16:17.690922 dv-cinder-804735-16-iscsi devstack@n-api.service[102570]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 16 14:16:17.693452 dv-cinder-804735-16-iscsi devstack@n-api.service[102570]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Feb 16 14:16:17 2022] *** Feb 16 14:16:17.693452 dv-cinder-804735-16-iscsi devstack@n-api.service[102570]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 16 14:16:17.693452 dv-cinder-804735-16-iscsi devstack@n-api.service[102570]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 16 14:16:17.693452 dv-cinder-804735-16-iscsi devstack@n-api.service[102570]: nodename: dv-cinder-804735-16-iscsi Feb 16 14:16:17.693452 dv-cinder-804735-16-iscsi devstack@n-api.service[102570]: machine: x86_64 Feb 16 14:16:17.693452 dv-cinder-804735-16-iscsi devstack@n-api.service[102570]: clock source: unix Feb 16 14:16:17.693452 dv-cinder-804735-16-iscsi devstack@n-api.service[102570]: pcre jit disabled Feb 16 14:16:17.693452 dv-cinder-804735-16-iscsi devstack@n-api.service[102570]: detected number of CPU cores: 4 Feb 16 14:16:17.693452 dv-cinder-804735-16-iscsi devstack@n-api.service[102570]: current working directory: / Feb 16 14:16:17.693452 dv-cinder-804735-16-iscsi devstack@n-api.service[102570]: detected binary path: /usr/bin/uwsgi-core Feb 16 14:16:17.694045 dv-cinder-804735-16-iscsi devstack@n-api.service[102570]: your processes number limit is 47680 Feb 16 14:16:17.694045 dv-cinder-804735-16-iscsi devstack@n-api.service[102570]: your memory page size is 4096 bytes Feb 16 14:16:17.694045 dv-cinder-804735-16-iscsi devstack@n-api.service[102570]: detected max file descriptor number: 2048 Feb 16 14:16:17.694045 dv-cinder-804735-16-iscsi devstack@n-api.service[102570]: lock engine: pthread robust mutexes Feb 16 14:16:17.694045 dv-cinder-804735-16-iscsi devstack@n-api.service[102570]: thunder lock: enabled Feb 16 14:16:17.694045 dv-cinder-804735-16-iscsi devstack@n-api.service[102570]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 16 14:16:17.694045 dv-cinder-804735-16-iscsi devstack@n-api.service[102570]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 16 14:16:17.738286 dv-cinder-804735-16-iscsi devstack@n-api.service[102570]: Python main interpreter initialized at 0x5653470229c0 Feb 16 14:16:17.738286 dv-cinder-804735-16-iscsi devstack@n-api.service[102570]: python threads support enabled Feb 16 14:16:17.738286 dv-cinder-804735-16-iscsi devstack@n-api.service[102570]: your server socket listen backlog is limited to 100 connections Feb 16 14:16:17.738286 dv-cinder-804735-16-iscsi devstack@n-api.service[102570]: your mercy for graceful operations on workers is 90 seconds Feb 16 14:16:17.738669 dv-cinder-804735-16-iscsi devstack@n-api.service[102570]: mapped 403077 bytes (393 KB) for 2 cores Feb 16 14:16:17.738761 dv-cinder-804735-16-iscsi devstack@n-api.service[102570]: *** Operational MODE: preforking *** Feb 16 14:16:17.739552 dv-cinder-804735-16-iscsi devstack@n-api.service[102570]: *** uWSGI is running in multiple interpreter mode *** Feb 16 14:16:17.739552 dv-cinder-804735-16-iscsi devstack@n-api.service[102570]: spawned uWSGI master process (pid: 102570) Feb 16 14:16:17.739801 dv-cinder-804735-16-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 16 14:16:17.740350 dv-cinder-804735-16-iscsi devstack@n-api.service[102570]: spawned uWSGI worker 1 (pid: 102571, cores: 1) Feb 16 14:16:17.740618 dv-cinder-804735-16-iscsi devstack@n-api.service[102570]: spawned uWSGI worker 2 (pid: 102572, cores: 1) Feb 16 14:16:17.740795 dv-cinder-804735-16-iscsi devstack@n-api.service[102570]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 16 14:16:19.586418 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 16 14:16:19.586418 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: from cryptography.utils import int_from_bytes Feb 16 14:16:19.587099 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 16 14:16:19.587099 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: from cryptography.utils import int_from_bytes Feb 16 14:16:19.595352 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 16 14:16:19.595352 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: from cryptography.utils import int_from_bytes Feb 16 14:16:19.595844 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 16 14:16:19.595844 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: from cryptography.utils import int_from_bytes Feb 16 14:16:22.224001 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 16 14:16:22.224669 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 16 14:16:22.224762 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 16 14:16:22.225083 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 16 14:16:22.225197 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 16 14:16:22.225608 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 16 14:16:22.225732 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 16 14:16:22.225864 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.226011 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 16 14:16:22.226148 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.226272 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 16 14:16:22.226397 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.226518 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 16 14:16:22.226658 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.226870 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.227021 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.227197 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.227332 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.227522 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.227657 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.227846 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.227984 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.228181 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.228304 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.228430 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.228563 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.228739 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.228864 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.229066 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804735-16-iscsi {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.229209 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.229389 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.229492 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.229683 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.229777 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.229999 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.230100 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.230313 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.230406 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804735-16-iscsi {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.230719 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.230894 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.231030 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.231161 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.231296 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.231453 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.231593 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.231819 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.231991 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.232158 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.232485 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.232628 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.232842 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.233158 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.233498 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.233815 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.234129 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.234450 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.234788 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.235115 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.235427 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.235910 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804735-16-iscsi {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.236233 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.236370 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.236553 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.236805 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.236905 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.237032 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.237277 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.237372 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.237590 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.237709 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.237905 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.238040 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.238226 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.238365 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.238548 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.238722 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.239444 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.239567 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.239715 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.239885 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.240035 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.240244 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.240353 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.240673 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.240763 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804735-16-iscsi {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.240978 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.241084 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.241290 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.241431 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.241601 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.241756 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.241923 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.242184 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.242284 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.242508 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.242602 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.242792 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.242875 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.243106 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.243203 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.243430 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.243521 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.243753 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.243850 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.244076 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.244175 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.244329 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.244414 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.244580 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.244733 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.244897 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.245060 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.245218 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.245370 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.245530 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.245687 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.245840 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.246003 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.246152 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.246331 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.246462 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.246664 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.246800 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.246986 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.247086 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.247236 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.247392 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.247550 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.247703 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.247883 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.248022 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.248212 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.248344 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.248539 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.248667 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.248796 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.248979 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.249073 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.249302 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.249395 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.249675 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.249762 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.110 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.249940 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.110 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.250023 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.250252 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.250337 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.250593 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.250690 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.250929 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.251022 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.251242 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.251326 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.251554 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.251644 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.251867 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.251951 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.252178 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.252275 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.252488 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.252578 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.252796 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.252893 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.253116 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.253208 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.253429 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.253519 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.253735 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.253825 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.253985 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.254143 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.110 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.254290 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.254494 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.110 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.255223 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.255316 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.255547 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.255669 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.255857 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.255994 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.256167 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.256311 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.256475 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.256636 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.256783 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.256964 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.257090 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.257280 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.257400 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.257591 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.257707 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.257911 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.258010 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.258235 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.258322 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.258565 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.258692 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.258910 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.259006 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.259163 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.259250 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.259469 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.259578 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.259782 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.259887 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.260102 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.260196 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.260415 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.260501 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.260722 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.260821 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.261031 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.261118 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.261331 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.261417 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.261642 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.261741 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.261948 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.262033 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.262257 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.262352 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.262564 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.262690 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.262900 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.262993 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.263204 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.263289 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.263515 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.263676 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.263825 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.263916 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.264132 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.264217 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.264450 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.264536 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.264754 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.264839 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.265063 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.265149 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.265370 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.265464 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.265679 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.265773 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.265984 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.266078 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.266291 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.266386 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.266597 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.266748 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.266927 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.267013 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.267234 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.267322 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.267539 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.267624 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.267847 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.267933 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.268149 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.268259 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.268468 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.268562 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.268780 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.268866 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.269090 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.269181 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.269395 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.269480 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.269701 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.269795 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.270018 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.270137 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.270381 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.270535 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.270725 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.270850 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.271042 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.271206 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.271356 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.271526 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.271666 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.271860 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.271977 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.272237 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.272342 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.272512 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.272608 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.272830 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.272924 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.273145 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.273231 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.273473 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.273570 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.273786 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.273873 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.274097 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.274182 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.274407 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.274501 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.274750 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.274857 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:16:22.275073 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.275160 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.275408 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.275535 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.275727 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.275834 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.276044 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.276140 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.276363 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.276503 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.276675 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.276804 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.276998 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.277097 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.277313 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.277400 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.277639 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.277748 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.277953 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.278041 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.278271 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.278357 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.278588 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.278710 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.278928 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.279015 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.279254 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.279340 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.279577 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.279669 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.279895 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.280037 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.280210 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.280349 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.280523 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.280660 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.280844 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.280981 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.281161 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.281299 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.281473 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.281627 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.281793 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.281890 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.282108 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.282194 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.282420 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.282507 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.282756 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.282863 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.283073 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.283160 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.283387 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.283473 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.283722 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.283816 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.284040 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.284128 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.284360 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.284453 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.284674 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.284772 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.284991 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.285088 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.285304 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.285395 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.285619 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.286353 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.286597 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.286776 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.286923 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.287037 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.287244 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.287333 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.287563 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.287670 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.287875 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.287967 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.288186 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.288274 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.288500 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.288586 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.288827 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.288911 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.289146 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.289240 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.289464 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.289550 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.289776 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.289862 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.290092 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.290188 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.290403 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.290489 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.290741 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.290844 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.291049 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.291134 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.291359 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.291451 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.291670 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.291767 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.291977 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.292063 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.292290 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.292375 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.292603 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.292702 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.292909 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.293001 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.293232 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.293319 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.293540 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.293636 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.293846 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.293933 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.294163 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.294255 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.294475 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.294568 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.294813 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.294900 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.295129 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.295216 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.295442 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.295531 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.295754 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.295838 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.296067 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.296160 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.296375 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.296461 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.296702 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.296787 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.297014 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.297098 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.297322 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.297417 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.297648 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.297734 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.297959 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.298054 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.298263 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.298348 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.298575 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.298682 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.298914 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.299014 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.299223 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.299309 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.299529 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.299621 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.299841 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.299946 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.300146 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.300249 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.300450 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.300537 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.300755 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.300852 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.301081 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.301176 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.301418 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.302069 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.302274 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.302429 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.302657 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.302770 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.302979 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.303068 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.303291 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.303379 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.303608 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.303692 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.303920 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.304012 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.304232 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.304317 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.304542 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.304626 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.304857 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.304941 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.305167 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.305251 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.305478 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.305561 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.305784 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.305877 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.306095 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.306179 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.306404 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.306488 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.306740 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.306840 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.307059 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.307144 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.307371 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.307518 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.307681 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.307836 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.307974 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.308113 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.308302 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.308444 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.308616 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.308765 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.308946 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.309090 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.309258 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.309419 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.309565 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.309706 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.309872 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.310008 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.310193 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.310336 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.310525 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.310674 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.310877 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.311014 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.311194 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.311332 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.311495 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.311632 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.311813 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.311955 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.312130 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.312267 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.312442 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.312585 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.312755 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.312846 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.313067 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.313154 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.313378 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.313493 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.313693 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.313779 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.314002 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.314096 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.314316 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.314402 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.314677 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.314768 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.314972 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.315073 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.315282 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.315378 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.315603 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.315692 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.315908 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.316070 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.316227 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.316314 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.316544 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.316629 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.316859 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.317079 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.317292 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.317445 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.317597 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.317757 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.317911 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.318007 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.318240 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.318331 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.318554 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.318661 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.318902 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.318996 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.319211 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.319296 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.319521 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.319608 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.319833 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.319920 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.320150 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.320287 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.320457 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.320542 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.320767 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.320853 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.321075 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.321161 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.321393 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.321486 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.321705 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.321793 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.322012 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.322098 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.322319 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.322413 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.322665 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.322795 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.322968 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.323054 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.323280 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.323386 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.323588 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.323683 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.323898 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.323985 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.324209 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.324306 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.324516 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.324603 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.324828 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.324921 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.325138 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.325278 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.325445 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.325531 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.325751 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.325837 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.326058 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.326146 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.326367 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.326451 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.326699 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.326800 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.327020 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.327108 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.327336 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.327420 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.327651 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.327737 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.327963 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.328056 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.328279 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.328365 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.328592 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.328723 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.328901 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.328991 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.329221 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.329306 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.329537 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.329636 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.329847 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.329932 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.330156 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.330241 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.330466 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.330563 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.330804 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.330894 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.331116 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.331203 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.331433 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.331532 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.331742 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.331828 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.332055 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.332141 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.332366 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.332466 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.332714 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.332864 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.333031 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.333195 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.333363 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.333506 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.333657 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.333976 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.334063 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.334292 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.334389 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.334609 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.334734 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.334946 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.335059 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.335263 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.335384 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.335580 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.335704 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.335907 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.336036 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.336221 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.336365 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.336537 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.336680 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.336852 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.337020 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.337162 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.337335 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.337477 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.337645 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.337782 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.337953 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.338264 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.338351 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.338569 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.338692 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.338908 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.338996 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.339471 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.339577 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.339792 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.339885 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.340098 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.340208 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.340404 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.340545 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.340708 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.340879 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.341014 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.341198 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.341331 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.341538 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.341627 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.341856 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.342006 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.342170 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.342258 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.342481 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.342579 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.342821 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.342909 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.343133 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.343222 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.343442 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.343560 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.343744 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.343829 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.344056 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.344141 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.344367 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.344455 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.344673 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.344762 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.344982 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.345072 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.345290 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.345386 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.345609 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.345697 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.345919 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.346012 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.346236 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.346336 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.346541 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.346647 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.346874 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.346960 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.347180 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.347275 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.347487 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.347573 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.347792 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.347885 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.348097 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.348696 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.348966 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.349118 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.349270 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.349430 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.349641 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.349782 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.349954 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.350114 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.350260 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.350461 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.350600 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.350801 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.350888 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.351113 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.351201 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.351441 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.351530 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.351750 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.351836 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.352061 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.352156 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.352370 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.352456 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.352678 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.352762 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.352984 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.353078 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.353292 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.353387 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.353592 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.353678 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.353907 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.354001 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.354210 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.354304 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.354517 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.354604 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.354846 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.354943 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.355155 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.355249 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.355461 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.355546 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.355765 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.355851 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.356079 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.356165 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.356386 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.356473 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.356690 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.356776 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.356996 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.357089 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.357307 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.357393 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.357612 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.357705 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.357916 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.358009 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.358218 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.358310 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.358536 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.358639 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.358866 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.358952 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.359174 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.359273 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.359482 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.359570 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.359796 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.359882 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.360108 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.360204 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.360417 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.360504 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.360725 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.360819 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.361032 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.361127 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.361337 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.361423 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.361641 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.361734 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.361946 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.362045 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.362251 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.362337 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.362556 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.362675 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.362897 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.362991 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.363203 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.363290 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.363509 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.363595 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.363859 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.364499 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.364708 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.364915 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.365076 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.365225 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.365471 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.365567 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.365788 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.365875 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.366110 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.366203 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.366432 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.366519 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.366765 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.366857 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.367076 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.367180 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.367386 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.367472 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.367688 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.367772 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.368008 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.368105 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.368322 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.368421 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.368631 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.368716 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.368938 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.369035 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.369247 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.369333 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.369567 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.369651 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.369882 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.369977 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.370196 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.370281 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.370518 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.370612 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.370868 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.370960 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.371190 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.371276 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.371495 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.371587 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.371805 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.371892 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.372119 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.372206 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.372431 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.372544 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.372740 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.372837 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.373050 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.373146 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.373363 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.373468 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.373669 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.373769 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.373977 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.374071 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.374287 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.374379 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.374601 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.374720 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.374932 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.375016 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.375245 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.375342 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.375558 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.375643 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.375865 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.375956 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.376175 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.376267 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.376489 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.376572 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.376796 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.376887 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.377105 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.377197 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.377408 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.377491 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.377720 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.377802 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.378040 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.378132 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.378340 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.378454 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.378681 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.378799 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.378998 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.379117 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.379315 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.379453 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.379782 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.379921 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.380091 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.380235 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.380393 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.380482 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.380706 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.380801 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.381012 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.381102 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.381408 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.381496 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.381723 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.381816 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.382033 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.382118 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.382341 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.382428 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.382671 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.382788 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.382981 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.383076 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.383294 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.383388 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.383619 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.383723 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.383926 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.384020 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.384231 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.384332 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.384537 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.384639 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.384860 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.384994 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.385164 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.385257 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.385487 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.385589 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.385826 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.385918 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.386200 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.386298 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.386507 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.386600 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.386884 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.386977 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.387202 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.387295 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.387515 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.387609 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.387825 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.387920 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.388143 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.388233 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.388476 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.388570 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.388783 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.388867 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.389090 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.389173 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.389400 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.389485 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.389722 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.389804 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.390028 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.390125 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.390347 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.390430 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.390687 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.390775 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.390997 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.391106 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.391318 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.391404 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.391640 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.391799 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.392124 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.392310 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.392401 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.392488 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.392667 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.392754 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.392992 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.393084 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.393306 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.393399 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.393627 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.393711 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.393949 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.394047 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.394257 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.394355 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.394564 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.394664 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.394903 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.394987 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.395281 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.395382 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.395604 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.395689 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.395916 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.396001 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.396223 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.396308 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.396536 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.396622 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.396848 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.396933 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.397159 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.397245 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.397465 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.397587 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.397769 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.397917 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.398090 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.398237 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.398396 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.398571 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.398743 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.398926 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.399066 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.399239 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.399387 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.399550 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.399709 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.399868 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.400015 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.400180 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.400339 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.400492 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.400649 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.400817 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.400955 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.401184 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.401283 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.401438 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.401536 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.401753 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.401878 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.402068 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.402184 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.402377 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.402505 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.402710 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.402861 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.403038 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.403194 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.403347 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.403508 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.403677 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.403843 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.403995 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.404170 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.404320 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.404489 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.404645 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.404810 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.404956 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.405136 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.405286 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.405445 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.405602 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.405754 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.405910 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.406069 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.406220 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.406377 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.406528 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.406708 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.406912 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.407018 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.407222 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.407332 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.407548 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.407635 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.407883 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.407968 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.408215 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.408300 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.408535 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.408620 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.408849 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.408949 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.409173 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.409258 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.409485 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.409582 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.409794 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.409892 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.410103 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.410189 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.410410 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.410496 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.411268 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.411438 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.411580 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.411733 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.411873 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.411996 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.412193 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.412342 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.412485 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.412671 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.412800 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.413007 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.413105 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.413326 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.413413 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.413654 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.413756 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.413981 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.414094 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.414301 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.414390 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.414641 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.414730 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.414959 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.415059 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.415275 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.415363 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.415597 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.415684 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.415917 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.416012 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.416232 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.416320 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.416554 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.416647 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.416875 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.416963 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.417197 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.417290 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.417526 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.417721 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.417860 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.418053 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.418177 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.418373 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.418575 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.418718 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.418883 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.419037 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.419171 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.419362 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.419496 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.419681 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.419820 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.419998 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.420143 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.420315 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.420466 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.420631 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.420788 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.420945 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.421105 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.421275 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.421427 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.421596 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.421749 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.421917 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.422072 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.422455 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.422596 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.422723 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.422899 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.422997 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.423217 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.423304 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.423534 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.423622 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.423858 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.423944 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.424184 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.424284 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.424492 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.424579 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.424805 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.424899 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.425120 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.425205 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.425435 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.425529 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.425747 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.425839 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.426058 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.426154 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.426453 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.426729 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.427077 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.427422 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.428713 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.428888 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.429042 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.429229 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.429569 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.430068 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.430186 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.430568 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.430920 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.431347 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.431498 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.431834 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.432011 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.432161 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.432456 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.432791 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.433118 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.434481 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.434663 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.434891 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.435013 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.435233 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.435348 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.435570 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.435691 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.435901 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.436018 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.436233 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.436356 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.436575 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.436783 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.436923 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.437117 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.437233 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.437466 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.437590 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.437807 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.437921 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.438146 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.438260 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.438478 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.438808 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.438933 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.439066 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.439188 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.439408 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.439538 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.439745 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.439898 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.440064 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.440161 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.440384 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.440481 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.440697 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.440784 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.441024 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.441112 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.441338 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.441434 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.441648 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.441735 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.442544 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.442708 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.442959 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.443133 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.443309 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.443496 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.443639 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.443852 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.443955 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.444182 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.444627 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.444731 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.444961 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.445050 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.445286 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.445375 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.445659 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.445831 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.445987 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.446194 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.446291 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.446526 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.446616 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.446891 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.446993 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.447230 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.447319 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.447540 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.447634 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.447852 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.447946 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.448169 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.448262 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.448485 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.448580 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.448798 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.448908 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.449120 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.449219 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.449427 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.449514 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.449738 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.449850 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.450053 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.450150 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.450374 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.450470 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.450716 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.450821 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.451036 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.451123 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.451348 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.451435 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.451659 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.451798 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.451974 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.452061 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.452284 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.452372 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.452600 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.452696 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.452915 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.453002 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.453235 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.453322 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.453542 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.453636 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.453852 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.453948 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.454161 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.454247 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.454471 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.454566 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.454805 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.454892 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.455183 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.455269 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.455491 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.455579 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.455799 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.455886 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.456119 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.456205 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.456428 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.456515 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.456745 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.456834 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.457057 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.457144 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.457371 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.457460 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.458287 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.458451 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.458605 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.458863 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.458950 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.459247 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.459346 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.459576 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.459665 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.459897 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.459986 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.460217 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.460317 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.460567 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.460656 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.460894 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.460983 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.461204 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.461429 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.461518 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.461772 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.461913 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.462100 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.462188 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.462433 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.462527 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.462782 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.462872 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.463095 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.463198 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.463407 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.463503 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.463719 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.463805 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.464031 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.464118 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.464619 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.464721 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.464933 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.465021 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.465248 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.465334 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.465559 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.465652 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.465872 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.465958 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.466192 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.466279 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.466510 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.466606 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.466853 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.466953 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.467171 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.467260 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.467488 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.467590 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.467799 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.467892 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.468112 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.468201 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.468425 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.468530 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.468733 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.468821 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.469052 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.469138 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.469386 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.469488 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.469698 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.469787 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.470004 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.470091 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.470318 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.470414 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.470660 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.470772 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.470972 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.471062 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.471294 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.471383 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.471627 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.471716 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.471948 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.472043 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.472258 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.472345 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.472592 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.472686 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.472916 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.473013 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.473263 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.473431 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.473753 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.473929 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.474123 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.474230 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.474408 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.474497 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.474756 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.474849 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.475070 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.475161 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.475384 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.475480 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.475693 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.475790 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.476007 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.476096 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.476337 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.476424 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.476671 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.476757 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.476988 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.477077 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.477297 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.477383 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.477611 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.477706 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.477921 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.478009 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.478233 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.478325 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.478553 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.478684 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.478904 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.479001 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.479221 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.479308 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.479533 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.479640 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.479855 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.479950 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.480168 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.480302 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.480484 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.480588 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.480795 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.480881 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.481109 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.481197 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.481422 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.481510 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.481735 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.481821 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.482057 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.482142 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.482375 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.482462 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.482704 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.482806 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.483023 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.483111 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.483340 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.483437 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.483656 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.483743 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.483969 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.484063 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.484283 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.484379 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.484612 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.484707 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.484923 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.485055 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.485248 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.485336 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.485561 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.485648 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.485874 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.485971 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.486193 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.486287 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.486508 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.486597 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.486864 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.486954 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.487178 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.487264 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.487501 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.487587 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.487819 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.487909 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.488140 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.488264 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.488466 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.488560 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.488807 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.488907 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.489143 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.489262 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.489524 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.489615 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.489891 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.489981 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.490202 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.490311 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.490445 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102571) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 16 14:16:22.490575 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.490923 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.492938 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.492938 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.492938 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.492938 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.492938 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:16:22.492938 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 16 14:16:22.513443 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG oslo_db.sqlalchemy.engines [None req-df8f7b3a-08f3-43d9-b157-6842f464756c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102571) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 16 14:16:22.515228 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG oslo_db.sqlalchemy.engines [None req-62f6e4ee-9fcf-4371-993c-50922b4f2a2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102572) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 16 14:16:22.578223 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.context [None req-62f6e4ee-9fcf-4371-993c-50922b4f2a2c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d50d195e-47a1-45e7-9830-39e8ce60e8f3(cell1) {{(pid=102572) load_cells /opt/stack/nova/nova/context.py:464}} Feb 16 14:16:22.578898 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.context [None req-df8f7b3a-08f3-43d9-b157-6842f464756c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d50d195e-47a1-45e7-9830-39e8ce60e8f3(cell1) {{(pid=102571) load_cells /opt/stack/nova/nova/context.py:464}} Feb 16 14:16:22.582437 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG oslo_concurrency.lockutils [None req-62f6e4ee-9fcf-4371-993c-50922b4f2a2c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:16:22.584034 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG oslo_concurrency.lockutils [None req-df8f7b3a-08f3-43d9-b157-6842f464756c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=102571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:16:22.584608 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG oslo_concurrency.lockutils [None req-62f6e4ee-9fcf-4371-993c-50922b4f2a2c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:16:22.585422 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG oslo_concurrency.lockutils [None req-62f6e4ee-9fcf-4371-993c-50922b4f2a2c None None] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:16:22.585676 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG oslo_concurrency.lockutils [None req-df8f7b3a-08f3-43d9-b157-6842f464756c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:16:22.586491 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG oslo_concurrency.lockutils [None req-df8f7b3a-08f3-43d9-b157-6842f464756c None None] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:16:22.587386 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG oslo_concurrency.lockutils [None req-62f6e4ee-9fcf-4371-993c-50922b4f2a2c None None] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102572) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:16:22.588460 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG oslo_concurrency.lockutils [None req-df8f7b3a-08f3-43d9-b157-6842f464756c None None] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:16:22.597971 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG oslo_db.sqlalchemy.engines [None req-62f6e4ee-9fcf-4371-993c-50922b4f2a2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102572) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 16 14:16:22.600921 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG oslo_db.sqlalchemy.engines [None req-df8f7b3a-08f3-43d9-b157-6842f464756c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102571) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 16 14:16:22.603685 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG oslo_db.sqlalchemy.engines [None req-62f6e4ee-9fcf-4371-993c-50922b4f2a2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102572) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 16 14:16:22.606581 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG oslo_db.sqlalchemy.engines [None req-df8f7b3a-08f3-43d9-b157-6842f464756c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102571) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 16 14:16:22.761646 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG oslo_db.sqlalchemy.engines [None req-62f6e4ee-9fcf-4371-993c-50922b4f2a2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102572) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 16 14:16:22.771590 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG oslo_db.sqlalchemy.engines [None req-df8f7b3a-08f3-43d9-b157-6842f464756c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102571) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 16 14:16:23.280773 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: WARNING keystonemiddleware.auth_token [None req-62f6e4ee-9fcf-4371-993c-50922b4f2a2c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 16 14:16:23.288215 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: WARNING keystonemiddleware.auth_token [None req-62f6e4ee-9fcf-4371-993c-50922b4f2a2c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 16 14:16:23.311205 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: WARNING keystonemiddleware.auth_token [None req-df8f7b3a-08f3-43d9-b157-6842f464756c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 16 14:16:23.318047 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: WARNING keystonemiddleware.auth_token [None req-df8f7b3a-08f3-43d9-b157-6842f464756c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 16 14:16:23.512583 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: WARNING keystonemiddleware.auth_token [None req-62f6e4ee-9fcf-4371-993c-50922b4f2a2c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 16 14:16:23.517714 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: WARNING keystonemiddleware.auth_token [None req-62f6e4ee-9fcf-4371-993c-50922b4f2a2c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 16 14:16:23.523549 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5653470229c0 pid: 102572 (default app) Feb 16 14:16:23.525591 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-62f6e4ee-9fcf-4371-993c-50922b4f2a2c None None] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:16:23.526821 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-62f6e4ee-9fcf-4371-993c-50922b4f2a2c None None] 10.222.0.110 "GET /compute/v2.1/" status: 200 len: 389 microversion: 2.1 time: 0.001747 Feb 16 14:16:23.527238 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 1/1] 10.222.0.110 () {50 vars in 793 bytes} [Wed Feb 16 14:16:23 2022] GET /compute/v2.1/ => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:16:23.548234 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: WARNING keystonemiddleware.auth_token [None req-df8f7b3a-08f3-43d9-b157-6842f464756c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 16 14:16:23.554089 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: WARNING keystonemiddleware.auth_token [None req-df8f7b3a-08f3-43d9-b157-6842f464756c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 16 14:16:23.559612 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5653470229c0 pid: 102571 (default app) Feb 16 14:17:48.571030 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-62f6e4ee-9fcf-4371-993c-50922b4f2a2c None None] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:17:48.572018 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-62f6e4ee-9fcf-4371-993c-50922b4f2a2c None None] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001446 Feb 16 14:17:48.572408 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 2/2] 10.222.0.110 () {54 vars in 935 bytes} [Wed Feb 16 14:17:48 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:17:49.003612 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi [None req-6e6d021d-f4c2-4ecb-ba29-9dd1395eb1c7 admin admin] Calling method '>' {{(pid=102571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:17:49.033205 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: INFO nova.api.openstack.requestlog [None req-6e6d021d-f4c2-4ecb-ba29-9dd1395eb1c7 admin admin] 10.222.0.110 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.454206 Feb 16 14:17:49.033946 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: [pid: 102571|app: 0|req: 1/3] 10.222.0.110 () {60 vars in 1296 bytes} [Wed Feb 16 14:17:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:17:51.426016 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-62f6e4ee-9fcf-4371-993c-50922b4f2a2c None None] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:17:51.427034 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-62f6e4ee-9fcf-4371-993c-50922b4f2a2c None None] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001451 Feb 16 14:17:51.430913 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 3/4] 10.222.0.110 () {54 vars in 935 bytes} [Wed Feb 16 14:17:51 2022] GET /compute/v2.1 => generated 389 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:17:51.486235 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi [None req-ce607fb5-7a71-47b1-af8e-04eb3ea6e22d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "ram": 256, "os-flavor-access:is_public": true, "name": "cirros256", "id": "c1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=102571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:17:51.504964 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:17:51.504964 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: warnings.warn(msg) Feb 16 14:17:51.624903 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: INFO nova.api.openstack.requestlog [None req-ce607fb5-7a71-47b1-af8e-04eb3ea6e22d admin admin] 10.222.0.110 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.61 time: 0.191690 Feb 16 14:17:51.625382 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: [pid: 102571|app: 0|req: 2/5] 10.222.0.110 () {64 vars in 1287 bytes} [Wed Feb 16 14:17:51 2022] POST /compute/v2.1/flavors => generated 409 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 16 14:17:51.842568 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-723d99c8-4b36-45a6-a14d-cdb2ce75d3d1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:17:51.844955 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:17:51.844955 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: warnings.warn(msg) Feb 16 14:17:51.953675 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-723d99c8-4b36-45a6-a14d-cdb2ce75d3d1 admin admin] 10.222.0.110 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.319722 Feb 16 14:17:51.954474 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 4/6] 10.222.0.110 () {64 vars in 1340 bytes} [Wed Feb 16 14:17:51 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:17:54.306584 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi [None req-ce607fb5-7a71-47b1-af8e-04eb3ea6e22d admin admin] Calling method '>' {{(pid=102571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:17:54.307620 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: INFO nova.api.openstack.requestlog [None req-ce607fb5-7a71-47b1-af8e-04eb3ea6e22d admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001484 Feb 16 14:17:54.308019 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: [pid: 102571|app: 0|req: 3/7] 10.222.0.110 () {54 vars in 935 bytes} [Wed Feb 16 14:17:54 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:17:54.426313 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-6c1a618b-3c3d-4970-8942-a6d28222254a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "id": "d1", "rxtx_factor": 1.0, "name": "ds512M"}} {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:17:54.446792 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:17:54.446792 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: warnings.warn(msg) Feb 16 14:17:54.571193 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-6c1a618b-3c3d-4970-8942-a6d28222254a admin admin] 10.222.0.110 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.257260 Feb 16 14:17:54.572211 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 5/8] 10.222.0.110 () {64 vars in 1287 bytes} [Wed Feb 16 14:17:54 2022] POST /compute/v2.1/flavors => generated 406 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 16 14:17:54.587747 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi [None req-e791f5c1-62a4-4e85-bfd9-bea2d41d2a75 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:17:54.589618 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:17:54.589618 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: warnings.warn(msg) Feb 16 14:17:54.682076 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: INFO nova.api.openstack.requestlog [None req-e791f5c1-62a4-4e85-bfd9-bea2d41d2a75 admin admin] 10.222.0.110 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100889 Feb 16 14:17:54.683016 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: [pid: 102571|app: 0|req: 4/9] 10.222.0.110 () {64 vars in 1340 bytes} [Wed Feb 16 14:17:54 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:17:57.032788 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-6c1a618b-3c3d-4970-8942-a6d28222254a admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:17:57.033789 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-6c1a618b-3c3d-4970-8942-a6d28222254a admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001448 Feb 16 14:17:57.034188 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 6/10] 10.222.0.110 () {54 vars in 935 bytes} [Wed Feb 16 14:17:57 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:17:57.092024 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi [None req-4d4b3757-0724-480e-abb2-2d54c85aa951 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "os-flavor-access:is_public": true, "name": "ds1G", "ram": 1024, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 10}} {{(pid=102571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:17:57.170115 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: INFO nova.api.openstack.requestlog [None req-4d4b3757-0724-480e-abb2-2d54c85aa951 admin admin] 10.222.0.110 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.129262 Feb 16 14:17:57.170663 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: [pid: 102571|app: 0|req: 5/11] 10.222.0.110 () {64 vars in 1287 bytes} [Wed Feb 16 14:17:57 2022] POST /compute/v2.1/flavors => generated 406 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 16 14:17:57.182704 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-7c741ef9-738d-49f6-917a-47b684efd929 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:17:57.269635 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-7c741ef9-738d-49f6-917a-47b684efd929 admin admin] 10.222.0.110 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089966 Feb 16 14:17:57.270310 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 7/12] 10.222.0.110 () {64 vars in 1340 bytes} [Wed Feb 16 14:17:57 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:17:59.743226 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi [None req-4d4b3757-0724-480e-abb2-2d54c85aa951 admin admin] Calling method '>' {{(pid=102571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:17:59.744272 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: INFO nova.api.openstack.requestlog [None req-4d4b3757-0724-480e-abb2-2d54c85aa951 admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001471 Feb 16 14:17:59.744805 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: [pid: 102571|app: 0|req: 6/13] 10.222.0.110 () {54 vars in 935 bytes} [Wed Feb 16 14:17:59 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:17:59.804436 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-58dba2c0-0eba-4768-865c-3a6d79d5419a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "rxtx_factor": 1.0, "ram": 2048, "vcpus": 2, "disk": 10, "name": "ds2G", "os-flavor-access:is_public": true}} {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:17:59.880858 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-58dba2c0-0eba-4768-865c-3a6d79d5419a admin admin] 10.222.0.110 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.130418 Feb 16 14:17:59.881400 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 8/14] 10.222.0.110 () {64 vars in 1287 bytes} [Wed Feb 16 14:17:59 2022] POST /compute/v2.1/flavors => generated 406 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 16 14:17:59.893176 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi [None req-9a2efd15-1eef-4d5f-9a1a-d0f5c5195180 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:18:00.001298 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: INFO nova.api.openstack.requestlog [None req-9a2efd15-1eef-4d5f-9a1a-d0f5c5195180 admin admin] 10.222.0.110 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.111129 Feb 16 14:18:00.005170 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: [pid: 102571|app: 0|req: 7/15] 10.222.0.110 () {64 vars in 1340 bytes} [Wed Feb 16 14:17:59 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:18:02.374039 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-58dba2c0-0eba-4768-865c-3a6d79d5419a admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:18:02.375229 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-58dba2c0-0eba-4768-865c-3a6d79d5419a admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001676 Feb 16 14:18:02.375933 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 9/16] 10.222.0.110 () {54 vars in 935 bytes} [Wed Feb 16 14:18:02 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:18:02.438304 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi [None req-2c4b13e2-24fd-49ae-9415-c455a51f4926 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "vcpus": 4, "disk": 20, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds4G", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=102571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:18:02.545483 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: INFO nova.api.openstack.requestlog [None req-2c4b13e2-24fd-49ae-9415-c455a51f4926 admin admin] 10.222.0.110 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.163033 Feb 16 14:18:02.551334 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: [pid: 102571|app: 0|req: 8/17] 10.222.0.110 () {64 vars in 1287 bytes} [Wed Feb 16 14:18:02 2022] POST /compute/v2.1/flavors => generated 406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 16 14:18:02.560818 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-bde417e0-9be3-4b6d-911b-9accae841be5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:18:02.624680 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-bde417e0-9be3-4b6d-911b-9accae841be5 admin admin] 10.222.0.110 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.070185 Feb 16 14:18:02.625243 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 10/18] 10.222.0.110 () {64 vars in 1340 bytes} [Wed Feb 16 14:18:02 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:18:05.026754 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi [None req-2c4b13e2-24fd-49ae-9415-c455a51f4926 admin admin] Calling method '>' {{(pid=102571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:18:05.029143 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: INFO nova.api.openstack.requestlog [None req-2c4b13e2-24fd-49ae-9415-c455a51f4926 admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001465 Feb 16 14:18:05.029610 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: [pid: 102571|app: 0|req: 9/19] 10.222.0.110 () {54 vars in 935 bytes} [Wed Feb 16 14:18:05 2022] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:18:05.089710 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-48299d1d-a90c-4883-a885-62754ae62fd7 admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:18:05.113990 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-48299d1d-a90c-4883-a885-62754ae62fd7 admin admin] 10.222.0.110 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2116 microversion: 2.61 time: 0.077185 Feb 16 14:18:05.114603 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 11/20] 10.222.0.110 () {60 vars in 1296 bytes} [Wed Feb 16 14:18:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2116 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:18:07.771023 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi [None req-2c4b13e2-24fd-49ae-9415-c455a51f4926 admin admin] Calling method '>' {{(pid=102571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:18:07.772028 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: INFO nova.api.openstack.requestlog [None req-2c4b13e2-24fd-49ae-9415-c455a51f4926 admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001472 Feb 16 14:18:07.772436 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: [pid: 102571|app: 0|req: 10/21] 10.222.0.110 () {54 vars in 935 bytes} [Wed Feb 16 14:18:07 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 14:18:07.829664 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-f2a4d985-28d8-492a-aa2b-e392d34f329b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "name": "m1.tiny", "os-flavor-access:is_public": true, "id": "1", "rxtx_factor": 1.0, "ram": 512, "swap": 0}} {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:18:07.908644 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-f2a4d985-28d8-492a-aa2b-e392d34f329b admin admin] 10.222.0.110 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.130249 Feb 16 14:18:07.910167 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 12/22] 10.222.0.110 () {64 vars in 1287 bytes} [Wed Feb 16 14:18:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 16 14:18:07.925205 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi [None req-366f28d3-0e11-44c7-9d00-ce2fe874a6d3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:18:08.012995 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: INFO nova.api.openstack.requestlog [None req-366f28d3-0e11-44c7-9d00-ce2fe874a6d3 admin admin] 10.222.0.110 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092551 Feb 16 14:18:08.013707 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: [pid: 102571|app: 0|req: 11/23] 10.222.0.110 () {64 vars in 1337 bytes} [Wed Feb 16 14:18:07 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:18:10.400940 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-f2a4d985-28d8-492a-aa2b-e392d34f329b admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:18:10.402270 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-f2a4d985-28d8-492a-aa2b-e392d34f329b admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001931 Feb 16 14:18:10.402898 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 13/24] 10.222.0.110 () {54 vars in 935 bytes} [Wed Feb 16 14:18:10 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:18:10.461589 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi [None req-90454cae-e1ea-43e9-b214-eed879bc936e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "name": "m1.small", "disk": 20, "ram": 2048}} {{(pid=102571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:18:10.535721 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: INFO nova.api.openstack.requestlog [None req-90454cae-e1ea-43e9-b214-eed879bc936e admin admin] 10.222.0.110 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.126740 Feb 16 14:18:10.536453 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: [pid: 102571|app: 0|req: 12/25] 10.222.0.110 () {64 vars in 1287 bytes} [Wed Feb 16 14:18:10 2022] POST /compute/v2.1/flavors => generated 407 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 16 14:18:10.549912 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-bb8912f7-d4d6-4d80-8d4b-54722c82135c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:18:10.640592 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-bb8912f7-d4d6-4d80-8d4b-54722c82135c admin admin] 10.222.0.110 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095549 Feb 16 14:18:10.641250 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 14/26] 10.222.0.110 () {64 vars in 1337 bytes} [Wed Feb 16 14:18:10 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:18:12.979839 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi [None req-90454cae-e1ea-43e9-b214-eed879bc936e admin admin] Calling method '>' {{(pid=102571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:18:12.980853 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: INFO nova.api.openstack.requestlog [None req-90454cae-e1ea-43e9-b214-eed879bc936e admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001490 Feb 16 14:18:12.981259 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: [pid: 102571|app: 0|req: 13/27] 10.222.0.110 () {54 vars in 935 bytes} [Wed Feb 16 14:18:12 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:18:13.040712 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-ea015ecd-b44f-44dd-b0bc-0c8b13702e4b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "os-flavor-access:is_public": true, "id": "3", "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.medium", "vcpus": 2}} {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:18:13.110156 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-ea015ecd-b44f-44dd-b0bc-0c8b13702e4b admin admin] 10.222.0.110 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.123044 Feb 16 14:18:13.110803 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 15/28] 10.222.0.110 () {64 vars in 1287 bytes} [Wed Feb 16 14:18:12 2022] POST /compute/v2.1/flavors => generated 408 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 16 14:18:13.122609 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi [None req-0ed7abce-9571-47ab-ad41-68eaedbf705e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:18:13.187353 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: INFO nova.api.openstack.requestlog [None req-0ed7abce-9571-47ab-ad41-68eaedbf705e admin admin] 10.222.0.110 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.068320 Feb 16 14:18:13.187931 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: [pid: 102571|app: 0|req: 14/29] 10.222.0.110 () {64 vars in 1337 bytes} [Wed Feb 16 14:18:13 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:18:15.579723 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-ea015ecd-b44f-44dd-b0bc-0c8b13702e4b admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:18:15.580793 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-ea015ecd-b44f-44dd-b0bc-0c8b13702e4b admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001474 Feb 16 14:18:15.581877 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 16/30] 10.222.0.110 () {54 vars in 935 bytes} [Wed Feb 16 14:18:15 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:18:15.641656 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi [None req-522b09c8-e50a-4aec-a50c-a889e363979e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "swap": 0, "disk": 80, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 4, "id": "4", "name": "m1.large"}} {{(pid=102571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:18:15.797293 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: INFO nova.api.openstack.requestlog [None req-522b09c8-e50a-4aec-a50c-a889e363979e admin admin] 10.222.0.110 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.209378 Feb 16 14:18:15.798459 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: [pid: 102571|app: 0|req: 15/31] 10.222.0.110 () {64 vars in 1287 bytes} [Wed Feb 16 14:18:15 2022] POST /compute/v2.1/flavors => generated 407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 16 14:18:15.813601 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-d0229544-e5b9-4b7f-b3ec-d91ca090c1ff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:18:15.920722 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-d0229544-e5b9-4b7f-b3ec-d91ca090c1ff admin admin] 10.222.0.110 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.110288 Feb 16 14:18:15.922154 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 17/32] 10.222.0.110 () {64 vars in 1337 bytes} [Wed Feb 16 14:18:15 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:18:18.280059 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi [None req-522b09c8-e50a-4aec-a50c-a889e363979e admin admin] Calling method '>' {{(pid=102571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:18:18.281741 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: INFO nova.api.openstack.requestlog [None req-522b09c8-e50a-4aec-a50c-a889e363979e admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002143 Feb 16 14:18:18.282319 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: [pid: 102571|app: 0|req: 16/33] 10.222.0.110 () {54 vars in 935 bytes} [Wed Feb 16 14:18:18 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:18:18.344384 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-5c815395-688b-4c38-aa35-12b42da0c1b2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "ram": 16384, "name": "m1.xlarge", "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "os-flavor-access:is_public": true, "id": "5"}} {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:18:18.415049 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-5c815395-688b-4c38-aa35-12b42da0c1b2 admin admin] 10.222.0.110 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.61 time: 0.126411 Feb 16 14:18:18.415930 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 18/34] 10.222.0.110 () {64 vars in 1287 bytes} [Wed Feb 16 14:18:18 2022] POST /compute/v2.1/flavors => generated 410 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 16 14:18:18.428088 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi [None req-dc38f643-e714-476f-99af-99c256e68fbb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:18:18.512359 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: INFO nova.api.openstack.requestlog [None req-dc38f643-e714-476f-99af-99c256e68fbb admin admin] 10.222.0.110 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087867 Feb 16 14:18:18.514681 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: [pid: 102571|app: 0|req: 17/35] 10.222.0.110 () {64 vars in 1337 bytes} [Wed Feb 16 14:18:18 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:18:42.830257 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-5c815395-688b-4c38-aa35-12b42da0c1b2 admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:18:42.831350 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-5c815395-688b-4c38-aa35-12b42da0c1b2 admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001477 Feb 16 14:18:42.831753 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 19/36] 10.222.0.110 () {54 vars in 935 bytes} [Wed Feb 16 14:18:42 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:18:42.889406 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi [None req-6452433e-14fd-477d-8685-c91cc6d7d00b admin admin] Calling method '>' {{(pid=102571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:18:42.906524 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: INFO nova.api.openstack.requestlog [None req-6452433e-14fd-477d-8685-c91cc6d7d00b admin admin] 10.222.0.110 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4222 microversion: 2.61 time: 0.069086 Feb 16 14:18:42.907087 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: [pid: 102571|app: 0|req: 18/37] 10.222.0.110 () {60 vars in 1296 bytes} [Wed Feb 16 14:18:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4222 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:18:44.316807 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-5c815395-688b-4c38-aa35-12b42da0c1b2 admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:18:44.317805 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-5c815395-688b-4c38-aa35-12b42da0c1b2 admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001462 Feb 16 14:18:44.318207 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 20/38] 10.222.0.110 () {56 vars in 1079 bytes} [Wed Feb 16 14:18:44 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:18:44.570343 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi [None req-0f20918e-f525-4862-88e3-6f7b930f7cd5 admin admin] Calling method '>' {{(pid=102571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:18:44.575864 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: INFO nova.api.openstack.wsgi [None req-0f20918e-f525-4862-88e3-6f7b930f7cd5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 16 14:18:44.576427 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi [None req-0f20918e-f525-4862-88e3-6f7b930f7cd5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:18:44.577221 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: INFO nova.api.openstack.requestlog [None req-0f20918e-f525-4862-88e3-6f7b930f7cd5 admin admin] 10.222.0.110 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.056854 Feb 16 14:18:44.577724 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: [pid: 102571|app: 0|req: 19/39] 10.222.0.110 () {60 vars in 1195 bytes} [Wed Feb 16 14:18:44 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 16 14:18:44.587545 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-18f1b9d4-b5d6-4e1e-9d3a-37e3d4c4ffd7 admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:18:44.608517 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-18f1b9d4-b5d6-4e1e-9d3a-37e3d4c4ffd7 admin admin] 10.222.0.110 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.024532 Feb 16 14:18:44.609053 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 21/40] 10.222.0.110 () {60 vars in 1215 bytes} [Wed Feb 16 14:18:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:18:44.618762 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi [None req-94aeb564-8089-4f18-a7aa-2b583f2c966a admin admin] Calling method '>' {{(pid=102571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:18:44.639160 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: INFO nova.api.openstack.requestlog [None req-94aeb564-8089-4f18-a7aa-2b583f2c966a admin admin] 10.222.0.110 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.023927 Feb 16 14:18:44.639688 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: [pid: 102571|app: 0|req: 20/41] 10.222.0.110 () {60 vars in 1215 bytes} [Wed Feb 16 14:18:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:18:44.649424 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-6e0ab61b-aea7-46a6-a3fd-227a3e6658f6 admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:18:44.654776 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.wsgi [None req-6e0ab61b-aea7-46a6-a3fd-227a3e6658f6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Feb 16 14:18:44.655329 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-6e0ab61b-aea7-46a6-a3fd-227a3e6658f6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:18:44.656105 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-6e0ab61b-aea7-46a6-a3fd-227a3e6658f6 admin admin] 10.222.0.110 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010258 Feb 16 14:18:44.656590 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 22/42] 10.222.0.110 () {60 vars in 1195 bytes} [Wed Feb 16 14:18:44 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 16 14:18:45.930074 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi [None req-94aeb564-8089-4f18-a7aa-2b583f2c966a admin admin] Calling method '>' {{(pid=102571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:18:45.931104 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: INFO nova.api.openstack.requestlog [None req-94aeb564-8089-4f18-a7aa-2b583f2c966a admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001487 Feb 16 14:18:45.931503 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: [pid: 102571|app: 0|req: 21/43] 10.222.0.110 () {56 vars in 1079 bytes} [Wed Feb 16 14:18:45 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:18:46.129700 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-63c5bde8-5ed5-4d93-990d-d060ff0569bd admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:18:46.135440 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.wsgi [None req-63c5bde8-5ed5-4d93-990d-d060ff0569bd admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 16 14:18:46.136002 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-63c5bde8-5ed5-4d93-990d-d060ff0569bd admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:18:46.136782 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-63c5bde8-5ed5-4d93-990d-d060ff0569bd admin admin] 10.222.0.110 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.068316 Feb 16 14:18:46.137285 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 23/44] 10.222.0.110 () {60 vars in 1195 bytes} [Wed Feb 16 14:18:46 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 16 14:18:46.148018 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi [None req-5d49555d-e453-46e1-b23f-a7f068759bb2 admin admin] Calling method '>' {{(pid=102571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:18:46.162261 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: INFO nova.api.openstack.requestlog [None req-5d49555d-e453-46e1-b23f-a7f068759bb2 admin admin] 10.222.0.110 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.019139 Feb 16 14:18:46.162825 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: [pid: 102571|app: 0|req: 22/45] 10.222.0.110 () {60 vars in 1215 bytes} [Wed Feb 16 14:18:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:18:46.172521 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-87c146f0-fa9c-4cf6-806c-038a46692092 admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:18:46.187266 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-87c146f0-fa9c-4cf6-806c-038a46692092 admin admin] 10.222.0.110 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.018174 Feb 16 14:18:46.187820 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 24/46] 10.222.0.110 () {60 vars in 1215 bytes} [Wed Feb 16 14:18:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:18:46.197558 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi [None req-348ac59b-dfbd-486a-8881-45ff6ee73911 admin admin] Calling method '>' {{(pid=102571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:18:46.202796 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: INFO nova.api.openstack.wsgi [None req-348ac59b-dfbd-486a-8881-45ff6ee73911 admin admin] HTTP exception thrown: Flavor 84 could not be found. Feb 16 14:18:46.203358 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi [None req-348ac59b-dfbd-486a-8881-45ff6ee73911 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:18:46.204139 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: INFO nova.api.openstack.requestlog [None req-348ac59b-dfbd-486a-8881-45ff6ee73911 admin admin] 10.222.0.110 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010262 Feb 16 14:18:46.204628 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: [pid: 102571|app: 0|req: 23/47] 10.222.0.110 () {60 vars in 1195 bytes} [Wed Feb 16 14:18:46 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 16 14:18:47.475995 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-87c146f0-fa9c-4cf6-806c-038a46692092 admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:18:47.476983 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-87c146f0-fa9c-4cf6-806c-038a46692092 admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001401 Feb 16 14:18:47.477400 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 25/48] 10.222.0.110 () {56 vars in 1079 bytes} [Wed Feb 16 14:18:47 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:18:47.681623 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi [None req-7008bdf0-384b-4b82-be82-96060e67c675 admin admin] Calling method '>' {{(pid=102571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:18:47.686845 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: INFO nova.api.openstack.wsgi [None req-7008bdf0-384b-4b82-be82-96060e67c675 admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 16 14:18:47.687336 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi [None req-7008bdf0-384b-4b82-be82-96060e67c675 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102571) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:18:47.688117 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: INFO nova.api.openstack.requestlog [None req-7008bdf0-384b-4b82-be82-96060e67c675 admin admin] 10.222.0.110 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057527 Feb 16 14:18:47.688614 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: [pid: 102571|app: 0|req: 24/49] 10.222.0.110 () {60 vars in 1198 bytes} [Wed Feb 16 14:18:47 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 16 14:18:47.698464 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-82d3cbdd-e6ff-4904-b280-440c2c703bcf admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:18:47.711845 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-82d3cbdd-e6ff-4904-b280-440c2c703bcf admin admin] 10.222.0.110 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.016862 Feb 16 14:18:47.712370 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 26/50] 10.222.0.110 () {60 vars in 1215 bytes} [Wed Feb 16 14:18:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:18:47.722397 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi [None req-f7370303-f5c7-4b06-b747-3c4df75146dd admin admin] Calling method '>' {{(pid=102571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:18:47.735276 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: INFO nova.api.openstack.requestlog [None req-f7370303-f5c7-4b06-b747-3c4df75146dd admin admin] 10.222.0.110 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.016985 Feb 16 14:18:47.737565 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: [pid: 102571|app: 0|req: 25/51] 10.222.0.110 () {60 vars in 1215 bytes} [Wed Feb 16 14:18:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:18:47.745513 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-607d35ee-d767-4a95-a6b2-00a466e66e68 admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:18:47.750837 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.wsgi [None req-607d35ee-d767-4a95-a6b2-00a466e66e68 admin admin] HTTP exception thrown: Flavor 451 could not be found. Feb 16 14:18:47.751396 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-607d35ee-d767-4a95-a6b2-00a466e66e68 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102572) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:18:47.752166 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-607d35ee-d767-4a95-a6b2-00a466e66e68 admin admin] 10.222.0.110 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010133 Feb 16 14:18:47.753491 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 27/52] 10.222.0.110 () {60 vars in 1198 bytes} [Wed Feb 16 14:18:47 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Feb 16 14:18:49.028106 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi [None req-f7370303-f5c7-4b06-b747-3c4df75146dd admin admin] Calling method '>' {{(pid=102571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:18:49.029124 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: INFO nova.api.openstack.requestlog [None req-f7370303-f5c7-4b06-b747-3c4df75146dd admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001405 Feb 16 14:18:49.029510 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: [pid: 102571|app: 0|req: 26/53] 10.222.0.110 () {56 vars in 1079 bytes} [Wed Feb 16 14:18:49 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:18:49.224295 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-047f60ef-dc8a-452e-8d70-7bb6b27a0f2a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:18:49.332073 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-047f60ef-dc8a-452e-8d70-7bb6b27a0f2a admin admin] 10.222.0.110 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.90 time: 0.159594 Feb 16 14:18:49.332603 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 28/54] 10.222.0.110 () {64 vars in 1240 bytes} [Wed Feb 16 14:18:49 2022] POST /compute/v2.1/flavors => generated 406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 16 14:18:50.595277 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi [None req-f7370303-f5c7-4b06-b747-3c4df75146dd admin admin] Calling method '>' {{(pid=102571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:18:50.596336 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: INFO nova.api.openstack.requestlog [None req-f7370303-f5c7-4b06-b747-3c4df75146dd admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001450 Feb 16 14:18:50.597030 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: [pid: 102571|app: 0|req: 27/55] 10.222.0.110 () {56 vars in 1079 bytes} [Wed Feb 16 14:18:50 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:18:50.789951 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-7b33f7ef-c322-426c-abcd-8fbb142d02d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:18:50.864224 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-7b33f7ef-c322-426c-abcd-8fbb142d02d3 admin admin] 10.222.0.110 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.125248 Feb 16 14:18:50.864801 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 29/56] 10.222.0.110 () {64 vars in 1240 bytes} [Wed Feb 16 14:18:50 2022] POST /compute/v2.1/flavors => generated 407 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 16 14:18:52.165361 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi [None req-f7370303-f5c7-4b06-b747-3c4df75146dd admin admin] Calling method '>' {{(pid=102571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:18:52.166355 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: INFO nova.api.openstack.requestlog [None req-f7370303-f5c7-4b06-b747-3c4df75146dd admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001409 Feb 16 14:18:52.166784 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: [pid: 102571|app: 0|req: 28/57] 10.222.0.110 () {56 vars in 1079 bytes} [Wed Feb 16 14:18:52 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:18:52.355403 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-cc77ff70-01b1-4eac-aabf-d797ee9d5247 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:18:52.430053 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-cc77ff70-01b1-4eac-aabf-d797ee9d5247 admin admin] 10.222.0.110 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.125679 Feb 16 14:18:52.430532 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 30/58] 10.222.0.110 () {64 vars in 1240 bytes} [Wed Feb 16 14:18:52 2022] POST /compute/v2.1/flavors => generated 409 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 16 14:18:53.839847 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi [None req-f7370303-f5c7-4b06-b747-3c4df75146dd admin admin] Calling method '>' {{(pid=102571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:18:53.840839 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: INFO nova.api.openstack.requestlog [None req-f7370303-f5c7-4b06-b747-3c4df75146dd admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001397 Feb 16 14:18:53.841234 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: [pid: 102571|app: 0|req: 29/59] 10.222.0.110 () {56 vars in 1079 bytes} [Wed Feb 16 14:18:53 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:18:54.043470 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-4dde8974-6012-44ff-92a6-9bb5e06b2157 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:18:54.098577 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-4dde8974-6012-44ff-92a6-9bb5e06b2157 admin admin] 10.222.0.110 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.90 time: 0.120169 Feb 16 14:18:54.099074 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 31/60] 10.222.0.110 () {64 vars in 1240 bytes} [Wed Feb 16 14:18:53 2022] POST /compute/v2.1/flavors => generated 411 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 16 14:18:55.374614 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi [None req-f7370303-f5c7-4b06-b747-3c4df75146dd admin admin] Calling method '>' {{(pid=102571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:18:55.375669 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: INFO nova.api.openstack.requestlog [None req-f7370303-f5c7-4b06-b747-3c4df75146dd admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001449 Feb 16 14:18:55.376064 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: [pid: 102571|app: 0|req: 30/61] 10.222.0.110 () {56 vars in 1079 bytes} [Wed Feb 16 14:18:55 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:18:55.564927 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-57e542ad-f565-428c-bdc4-042c3129e4ce admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:18:55.584390 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-57e542ad-f565-428c-bdc4-042c3129e4ce admin admin] 10.222.0.110 "GET /compute/v2.1/flavors/detail" status: 200 len: 5805 microversion: 2.90 time: 0.070338 Feb 16 14:18:55.584851 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 32/62] 10.222.0.110 () {60 vars in 1207 bytes} [Wed Feb 16 14:18:55 2022] GET /compute/v2.1/flavors/detail => generated 5805 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:19:46.816602 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi [None req-f7370303-f5c7-4b06-b747-3c4df75146dd admin admin] Calling method '>' {{(pid=102571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:19:46.817597 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: INFO nova.api.openstack.requestlog [None req-f7370303-f5c7-4b06-b747-3c4df75146dd admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001424 Feb 16 14:19:46.817999 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: [pid: 102571|app: 0|req: 31/63] 10.222.0.110 () {54 vars in 935 bytes} [Wed Feb 16 14:19:46 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:19:46.875269 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-89be4768-9d37-4390-9fba-d58240863bfb admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:19:46.894611 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-89be4768-9d37-4390-9fba-d58240863bfb admin admin] 10.222.0.110 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5819 microversion: 2.61 time: 0.070884 Feb 16 14:19:46.895155 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 33/64] 10.222.0.110 () {60 vars in 1296 bytes} [Wed Feb 16 14:19:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5819 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:19:46.916360 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi [None req-b5ad4649-bea6-4858-a87d-0f0a6d346e35 admin admin] Calling method '>' {{(pid=102571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:19:46.924700 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: INFO nova.api.openstack.requestlog [None req-b5ad4649-bea6-4858-a87d-0f0a6d346e35 admin admin] 10.222.0.110 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011649 Feb 16 14:19:46.925308 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: [pid: 102571|app: 0|req: 32/65] 10.222.0.110 () {60 vars in 1287 bytes} [Wed Feb 16 14:19:46 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:19:46.937704 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-fd229d09-ca4e-439b-a414-953c3ff1edfc admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:19:46.946484 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-fd229d09-ca4e-439b-a414-953c3ff1edfc admin admin] 10.222.0.110 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012314 Feb 16 14:19:46.947049 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 34/66] 10.222.0.110 () {60 vars in 1290 bytes} [Wed Feb 16 14:19:46 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:19:46.958188 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi [None req-9b11c0bc-1178-4ce0-8ca2-5b1506a2cafd admin admin] Calling method '>' {{(pid=102571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:19:46.965832 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: INFO nova.api.openstack.requestlog [None req-9b11c0bc-1178-4ce0-8ca2-5b1506a2cafd admin admin] 10.222.0.110 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011172 Feb 16 14:19:46.966338 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: [pid: 102571|app: 0|req: 33/67] 10.222.0.110 () {60 vars in 1290 bytes} [Wed Feb 16 14:19:46 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:19:46.978098 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-3a779b9a-5085-4230-8e7f-153d13dcca23 admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:19:46.986533 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-3a779b9a-5085-4230-8e7f-153d13dcca23 admin admin] 10.222.0.110 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011499 Feb 16 14:19:46.987094 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 35/68] 10.222.0.110 () {60 vars in 1287 bytes} [Wed Feb 16 14:19:46 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:21:30.526341 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi [None req-33e87b12-d7aa-434a-b890-e671f299b3a1 tempest-verify_tempest_config-1937258514 tempest-verify_tempest_config-1937258514-project] Calling method '>' {{(pid=102571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:21:30.528997 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: INFO nova.api.openstack.requestlog [None req-33e87b12-d7aa-434a-b890-e671f299b3a1 tempest-verify_tempest_config-1937258514 tempest-verify_tempest_config-1937258514-project] 10.222.0.110 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.107060 Feb 16 14:21:30.529521 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: [pid: 102571|app: 0|req: 34/69] 10.222.0.110 () {58 vars in 1138 bytes} [Wed Feb 16 14:21:30 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 16 14:23:13.526673 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-3a779b9a-5085-4230-8e7f-153d13dcca23 admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:23:13.527675 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-3a779b9a-5085-4230-8e7f-153d13dcca23 admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001478 Feb 16 14:23:13.528080 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 36/70] 10.222.0.110 () {56 vars in 1079 bytes} [Wed Feb 16 14:23:13 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:23:13.780811 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi [None req-6e7e6ba8-eff0-4fd2-ac60-40ff856815b5 admin admin] Calling method '>' {{(pid=102571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:23:13.781993 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:23:13.781993 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: warnings.warn(msg) Feb 16 14:23:13.783547 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG oslo_concurrency.lockutils [None req-6e7e6ba8-eff0-4fd2-ac60-40ff856815b5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:23:13.783985 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG oslo_concurrency.lockutils [None req-6e7e6ba8-eff0-4fd2-ac60-40ff856815b5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:23:13.784770 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG oslo_concurrency.lockutils [None req-6e7e6ba8-eff0-4fd2-ac60-40ff856815b5 admin admin] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:23:13.785221 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG oslo_concurrency.lockutils [None req-6e7e6ba8-eff0-4fd2-ac60-40ff856815b5 admin admin] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:23:13.821302 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: INFO nova.api.openstack.requestlog [None req-6e7e6ba8-eff0-4fd2-ac60-40ff856815b5 admin admin] 10.222.0.110 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.152090 Feb 16 14:23:13.826603 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: [pid: 102571|app: 0|req: 35/71] 10.222.0.110 () {60 vars in 1198 bytes} [Wed Feb 16 14:23:13 2022] GET /compute/v2.1/os-services => generated 794 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 16 14:23:15.117369 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-3a779b9a-5085-4230-8e7f-153d13dcca23 admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:23:15.118458 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-3a779b9a-5085-4230-8e7f-153d13dcca23 admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001738 Feb 16 14:23:15.118973 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 37/72] 10.222.0.110 () {56 vars in 1079 bytes} [Wed Feb 16 14:23:15 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:23:15.310070 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi [None req-cd9597e5-34fa-4998-ba7e-22bb80e97a7b admin admin] Calling method '>' {{(pid=102571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:23:15.311257 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:23:15.311257 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: warnings.warn(msg) Feb 16 14:23:15.312778 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG oslo_concurrency.lockutils [None req-cd9597e5-34fa-4998-ba7e-22bb80e97a7b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:23:15.313220 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG oslo_concurrency.lockutils [None req-cd9597e5-34fa-4998-ba7e-22bb80e97a7b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:23:15.314015 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG oslo_concurrency.lockutils [None req-cd9597e5-34fa-4998-ba7e-22bb80e97a7b admin admin] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:23:15.314439 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG oslo_concurrency.lockutils [None req-cd9597e5-34fa-4998-ba7e-22bb80e97a7b admin admin] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:23:15.333890 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: INFO nova.api.openstack.requestlog [None req-cd9597e5-34fa-4998-ba7e-22bb80e97a7b admin admin] 10.222.0.110 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.074075 Feb 16 14:23:15.334892 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: [pid: 102571|app: 0|req: 36/73] 10.222.0.110 () {60 vars in 1198 bytes} [Wed Feb 16 14:23:15 2022] GET /compute/v2.1/os-services => generated 794 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 16 14:23:27.132004 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-3a779b9a-5085-4230-8e7f-153d13dcca23 admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:23:27.132988 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-3a779b9a-5085-4230-8e7f-153d13dcca23 admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001399 Feb 16 14:23:27.133373 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 38/74] 10.222.0.110 () {56 vars in 1079 bytes} [Wed Feb 16 14:23:27 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:23:27.328041 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi [None req-c6b73f0f-4708-45c5-a073-56bba53c79b1 admin admin] Calling method '>' {{(pid=102571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:23:27.329167 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:23:27.329167 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: warnings.warn(msg) Feb 16 14:23:27.330718 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG oslo_concurrency.lockutils [None req-c6b73f0f-4708-45c5-a073-56bba53c79b1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:23:27.331190 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG oslo_concurrency.lockutils [None req-c6b73f0f-4708-45c5-a073-56bba53c79b1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:23:27.331991 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG oslo_concurrency.lockutils [None req-c6b73f0f-4708-45c5-a073-56bba53c79b1 admin admin] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:23:27.332417 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG oslo_concurrency.lockutils [None req-c6b73f0f-4708-45c5-a073-56bba53c79b1 admin admin] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:23:27.358003 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: INFO nova.api.openstack.requestlog [None req-c6b73f0f-4708-45c5-a073-56bba53c79b1 admin admin] 10.222.0.110 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.082383 Feb 16 14:23:27.358551 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: [pid: 102571|app: 0|req: 37/75] 10.222.0.110 () {60 vars in 1198 bytes} [Wed Feb 16 14:23:27 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:23:28.652600 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: DEBUG nova.api.openstack.wsgi [None req-3a779b9a-5085-4230-8e7f-153d13dcca23 admin admin] Calling method '>' {{(pid=102572) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:23:28.653605 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: INFO nova.api.openstack.requestlog [None req-3a779b9a-5085-4230-8e7f-153d13dcca23 admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001424 Feb 16 14:23:28.653991 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: [pid: 102572|app: 0|req: 39/76] 10.222.0.110 () {56 vars in 1079 bytes} [Wed Feb 16 14:23:28 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:23:28.843483 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG nova.api.openstack.wsgi [None req-daec0988-5e86-4720-9f15-bf5ab84ab202 admin admin] Calling method '>' {{(pid=102571) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:23:28.844677 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:23:28.844677 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: warnings.warn(msg) Feb 16 14:23:28.846218 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG oslo_concurrency.lockutils [None req-daec0988-5e86-4720-9f15-bf5ab84ab202 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:23:28.846679 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG oslo_concurrency.lockutils [None req-daec0988-5e86-4720-9f15-bf5ab84ab202 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:23:28.847503 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG oslo_concurrency.lockutils [None req-daec0988-5e86-4720-9f15-bf5ab84ab202 admin admin] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:23:28.847924 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: DEBUG oslo_concurrency.lockutils [None req-daec0988-5e86-4720-9f15-bf5ab84ab202 admin admin] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102571) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:23:28.869702 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: INFO nova.api.openstack.requestlog [None req-daec0988-5e86-4720-9f15-bf5ab84ab202 admin admin] 10.222.0.110 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.078111 Feb 16 14:23:28.870239 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: [pid: 102571|app: 0|req: 38/77] 10.222.0.110 () {60 vars in 1198 bytes} [Wed Feb 16 14:23:28 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:24:30.162372 dv-cinder-804735-16-iscsi devstack@n-api.service[102570]: Wed Feb 16 14:24:30 2022 - graceful shutdown triggered... Feb 16 14:24:30.162670 dv-cinder-804735-16-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Feb 16 14:24:30.163405 dv-cinder-804735-16-iscsi devstack@n-api.service[102571]: Gracefully killing worker 1 (pid: 102571)... Feb 16 14:24:30.163765 dv-cinder-804735-16-iscsi devstack@n-api.service[102572]: Gracefully killing worker 2 (pid: 102572)... Feb 16 14:24:31.162730 dv-cinder-804735-16-iscsi devstack@n-api.service[102570]: worker 1 buried after 1 seconds Feb 16 14:24:31.162730 dv-cinder-804735-16-iscsi devstack@n-api.service[102570]: worker 2 buried after 1 seconds Feb 16 14:24:31.162730 dv-cinder-804735-16-iscsi devstack@n-api.service[102570]: goodbye to uWSGI. Feb 16 14:24:31.164282 dv-cinder-804735-16-iscsi systemd[1]: devstack@n-api.service: Succeeded. Feb 16 14:24:31.164852 dv-cinder-804735-16-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Feb 16 14:24:31.168339 dv-cinder-804735-16-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Feb 16 14:24:31.181959 dv-cinder-804735-16-iscsi devstack@n-api.service[117012]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Feb 16 14:24:31.184274 dv-cinder-804735-16-iscsi devstack@n-api.service[117012]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Feb 16 14:24:31 2022] *** Feb 16 14:24:31.184274 dv-cinder-804735-16-iscsi devstack@n-api.service[117012]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 16 14:24:31.184274 dv-cinder-804735-16-iscsi devstack@n-api.service[117012]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 16 14:24:31.184274 dv-cinder-804735-16-iscsi devstack@n-api.service[117012]: nodename: dv-cinder-804735-16-iscsi Feb 16 14:24:31.184274 dv-cinder-804735-16-iscsi devstack@n-api.service[117012]: machine: x86_64 Feb 16 14:24:31.184274 dv-cinder-804735-16-iscsi devstack@n-api.service[117012]: clock source: unix Feb 16 14:24:31.184274 dv-cinder-804735-16-iscsi devstack@n-api.service[117012]: pcre jit disabled Feb 16 14:24:31.184274 dv-cinder-804735-16-iscsi devstack@n-api.service[117012]: detected number of CPU cores: 4 Feb 16 14:24:31.184274 dv-cinder-804735-16-iscsi devstack@n-api.service[117012]: current working directory: / Feb 16 14:24:31.184274 dv-cinder-804735-16-iscsi devstack@n-api.service[117012]: detected binary path: /usr/bin/uwsgi-core Feb 16 14:24:31.185043 dv-cinder-804735-16-iscsi devstack@n-api.service[117012]: your processes number limit is 47680 Feb 16 14:24:31.185043 dv-cinder-804735-16-iscsi devstack@n-api.service[117012]: your memory page size is 4096 bytes Feb 16 14:24:31.185043 dv-cinder-804735-16-iscsi devstack@n-api.service[117012]: detected max file descriptor number: 2048 Feb 16 14:24:31.185043 dv-cinder-804735-16-iscsi devstack@n-api.service[117012]: lock engine: pthread robust mutexes Feb 16 14:24:31.185043 dv-cinder-804735-16-iscsi devstack@n-api.service[117012]: thunder lock: enabled Feb 16 14:24:31.185043 dv-cinder-804735-16-iscsi devstack@n-api.service[117012]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Feb 16 14:24:31.185043 dv-cinder-804735-16-iscsi devstack@n-api.service[117012]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 16 14:24:31.233163 dv-cinder-804735-16-iscsi devstack@n-api.service[117012]: Python main interpreter initialized at 0x563af676f9c0 Feb 16 14:24:31.233163 dv-cinder-804735-16-iscsi devstack@n-api.service[117012]: python threads support enabled Feb 16 14:24:31.233163 dv-cinder-804735-16-iscsi devstack@n-api.service[117012]: your server socket listen backlog is limited to 100 connections Feb 16 14:24:31.233163 dv-cinder-804735-16-iscsi devstack@n-api.service[117012]: your mercy for graceful operations on workers is 90 seconds Feb 16 14:24:31.233623 dv-cinder-804735-16-iscsi devstack@n-api.service[117012]: mapped 403077 bytes (393 KB) for 2 cores Feb 16 14:24:31.233623 dv-cinder-804735-16-iscsi devstack@n-api.service[117012]: *** Operational MODE: preforking *** Feb 16 14:24:31.233885 dv-cinder-804735-16-iscsi devstack@n-api.service[117012]: *** uWSGI is running in multiple interpreter mode *** Feb 16 14:24:31.233885 dv-cinder-804735-16-iscsi devstack@n-api.service[117012]: spawned uWSGI master process (pid: 117012) Feb 16 14:24:31.234102 dv-cinder-804735-16-iscsi systemd[1]: Started Devstack devstack@n-api.service. Feb 16 14:24:31.234714 dv-cinder-804735-16-iscsi devstack@n-api.service[117012]: spawned uWSGI worker 1 (pid: 117031, cores: 1) Feb 16 14:24:31.235279 dv-cinder-804735-16-iscsi devstack@n-api.service[117012]: spawned uWSGI worker 2 (pid: 117032, cores: 1) Feb 16 14:24:31.235598 dv-cinder-804735-16-iscsi devstack@n-api.service[117012]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 16 14:24:33.171432 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 16 14:24:33.171432 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: from cryptography.utils import int_from_bytes Feb 16 14:24:33.172111 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 16 14:24:33.172111 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: from cryptography.utils import int_from_bytes Feb 16 14:24:33.173342 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 16 14:24:33.173342 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: from cryptography.utils import int_from_bytes Feb 16 14:24:33.173867 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 16 14:24:33.173867 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: from cryptography.utils import int_from_bytes Feb 16 14:24:35.661935 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 16 14:24:35.662473 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 16 14:24:35.662738 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 16 14:24:35.663076 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 16 14:24:35.663333 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 16 14:24:35.664120 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.664120 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.664443 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.668354 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.668354 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.668354 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.668354 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.668354 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.668354 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.668354 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.668354 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.668974 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804735-16-iscsi {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.668974 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.668974 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.668974 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.668974 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.668974 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.669344 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.669344 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.669840 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.671311 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.671311 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.671311 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.671311 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.671653 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.671872 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.672145 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.672457 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.672778 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.673096 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.673494 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804735-16-iscsi {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.673813 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.674122 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.674436 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.674881 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.675196 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.675516 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.675826 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.676143 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.676455 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.676786 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.677110 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.677434 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.677760 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.678057 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.678386 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.678704 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.679033 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.679342 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.679658 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.679916 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.680229 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.680554 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.680881 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.681208 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.681996 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.682252 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.682715 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.683022 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.683341 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.683655 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.683964 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.684276 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.684588 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.684899 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.685210 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.685522 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.685845 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.686165 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.686488 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.686824 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.687150 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.687552 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.110 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.687806 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.110 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.688119 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.688463 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.688833 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.689090 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.689411 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.689734 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.690054 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.690363 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.690693 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.691018 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.691348 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.691683 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.691906 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.692209 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.692519 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.692840 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.693148 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.693460 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.693787 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.694070 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.694379 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.694711 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.695024 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.695333 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.695645 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.695952 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.696264 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.696570 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.696874 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.697768 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.698096 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.698410 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.698744 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.699058 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.699369 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.699690 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.700004 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.700315 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.700640 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.700950 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.701257 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.701417 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 16 14:24:35.701889 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 16 14:24:35.702049 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.702049 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.702352 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 16 14:24:35.702505 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.702677 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 16 14:24:35.702838 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.702984 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 16 14:24:35.703177 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.703336 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.703487 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.703631 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.703800 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.704042 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.704288 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.704288 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.704694 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.704847 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.705000 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.705000 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.705284 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.705435 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.705602 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.705746 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.705889 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.706117 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.706290 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.706513 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.706787 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.706944 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.707089 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.707246 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804735-16-iscsi {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.707399 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.707793 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.707951 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.708108 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.708396 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.708563 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.708717 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.708868 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.709019 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.709256 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.709407 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.709568 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.709720 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.709866 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.710009 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.710009 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.710399 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.710577 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.710759 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.710914 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.711060 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.711210 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.711365 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.711510 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.711653 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.711796 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.711956 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.712126 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.712310 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.712465 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.712661 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.712895 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.713085 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.713247 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.713393 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.713548 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.713700 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.713851 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.714023 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804735-16-iscsi {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.714283 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.714522 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.714712 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.714863 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.715007 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.715167 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.715320 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.715464 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.715615 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.715767 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.715920 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.716071 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.716224 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.716379 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.716540 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.716779 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.716985 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.717135 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.717287 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.717431 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.717574 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.717719 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.717879 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.718035 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.718188 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.718343 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.718583 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.718756 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.718913 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.719057 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.719223 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.719438 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.719594 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.719750 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.719894 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.720045 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.720189 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.720339 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.720585 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.720747 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.720893 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.721046 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.721198 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.721342 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.721492 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.721651 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.721805 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.721957 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.722107 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.722257 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.722427 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.722579 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.722760 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.722915 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.723067 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.723210 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.723363 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.723507 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.723657 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.723800 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.723945 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.724086 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.724269 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.724480 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.724744 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.724902 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.725048 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.725201 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.725355 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.725499 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.725840 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.725999 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.726152 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.726383 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.726538 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.726782 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.727007 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.727158 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.727311 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.727470 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.727621 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.727773 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.727927 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.728071 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.110 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.728224 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.728391 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.110 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.728566 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.728848 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.729024 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.729171 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.729329 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.729558 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.729709 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.729853 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.729997 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.730140 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.730299 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.730454 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.730638 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.730860 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.731010 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.731175 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.731333 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.731485 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.731637 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.731788 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.731947 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.732104 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.732263 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.732409 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.732552 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.732703 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.732847 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.733011 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.733164 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.733308 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.733452 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.733594 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.733736 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.733888 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.734039 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.734183 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.734326 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.734498 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.734784 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.735033 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.735254 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.735404 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.735549 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.735700 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.735844 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.735987 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.736141 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.736285 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.736428 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.736572 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.736715 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.736858 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.737035 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.737256 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.737415 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.737561 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.737712 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.737856 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.738014 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.738170 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.738322 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.738474 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.738647 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.738835 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.739057 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.739215 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.739386 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.739558 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.739782 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.739946 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.740104 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.740255 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.740412 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.740565 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.740711 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.740874 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.741127 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.741288 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.741442 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.741608 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.741755 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.741903 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.742052 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.742211 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.742357 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.742509 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.742692 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.742857 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.743002 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.743196 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.743362 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.743519 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.743663 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.744322 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.744616 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.744917 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.745176 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.745338 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.745492 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.745644 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.745798 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.745991 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.746142 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.746295 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.746460 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.746613 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.746817 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.746963 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.747108 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.747270 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.747494 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.747643 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.747805 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.747950 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.748104 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.748249 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.748393 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.748556 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.748712 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.748869 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.748869 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.749247 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.749405 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.749559 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.749559 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.749940 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 16 14:24:35.750100 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.750254 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.750399 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.750650 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.750823 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.750969 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.751137 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.751365 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.751525 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.751685 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.751832 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.751986 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.752139 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.752284 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.752436 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.752595 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.752758 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.752910 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.753055 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.753198 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.753351 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.753496 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.753648 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.753792 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.753944 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.754107 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.754266 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.754412 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.754555 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.754786 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.755024 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.755193 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.755441 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.755600 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.755753 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.755898 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.756049 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.756202 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.756356 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.756516 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.756670 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.756821 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.756987 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.757146 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.757292 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.757473 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.757696 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.757845 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.757997 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.758157 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.758302 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.758455 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.758601 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.758768 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.758935 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.759095 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.759338 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.759588 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.760317 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.760478 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.760672 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.760879 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.761035 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.761188 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.761361 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.761361 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.761738 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.761896 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.762060 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.762206 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.762358 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.762510 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.762693 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.762986 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.763174 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.763333 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.763481 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.763625 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.763785 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.763939 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.764096 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.764240 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.764390 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.764535 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.764691 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.764691 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.764975 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.765220 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.765371 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.765711 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.765881 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.766036 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.766191 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.766348 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.766500 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.766718 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.766870 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.767024 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.767169 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.767312 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.767465 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.767618 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.767853 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.768013 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.768168 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.768452 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.768641 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.768803 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.768955 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.769101 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.769254 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.769406 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.769579 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.769870 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.770047 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.770203 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.770446 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.770613 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.770814 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.770960 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.771116 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.771262 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.771421 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.771590 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.771827 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.771999 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.772148 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.772292 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.772449 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.772594 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.772754 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.772910 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.773064 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.773218 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.773372 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.773517 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.773675 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.773821 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.773974 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.774118 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.774273 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.774429 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.774574 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.774767 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.774932 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.775122 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.775360 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.775523 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.775783 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.775935 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.775935 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.776210 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.776355 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.776531 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.776775 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.776951 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.777123 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.777269 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.777421 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.777576 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.777576 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.778018 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.778018 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.778333 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.778489 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.778654 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.778804 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.778963 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.781702 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.781984 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.782159 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.782324 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.782481 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.782706 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.782874 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.783023 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.783179 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.783334 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.783479 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.783708 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.783857 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.784011 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.784011 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.784307 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.784453 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.784606 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.784753 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.784898 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.785057 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.785203 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.785378 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.785611 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.785784 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.786026 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.786177 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.786332 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.786477 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.786654 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.786817 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.786972 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.787126 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.787271 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.787425 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.787585 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.787737 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.787737 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.788050 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.788266 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.788442 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.788588 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.788732 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.788885 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.789031 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.789176 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.789329 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.789474 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.789620 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.789764 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.789907 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.790053 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.790219 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.790376 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.790521 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.790766 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.790933 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.791090 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.791243 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.791675 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.792041 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.792203 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.792349 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.792504 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.792651 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.792807 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.792964 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.793120 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.793266 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.793420 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.793578 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.793724 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.793879 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.794025 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.794171 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.794325 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.794472 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.794642 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.794806 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.794962 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.795117 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.795265 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.795417 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.795589 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.795809 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.795968 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.796244 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.796412 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.796568 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.796723 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.796882 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.797039 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.797198 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.797355 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.797501 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.797646 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.797646 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.797931 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.798089 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.798254 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.798483 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.798685 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.798838 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.799007 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.799171 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.799323 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.799470 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.799614 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.799766 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.799926 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.800080 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.800233 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.800379 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.800534 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.800679 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.800832 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.800996 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.801141 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.801400 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.801561 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.801868 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.802029 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.802272 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.802421 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.802567 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.802748 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.802910 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.803076 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.803278 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.803447 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.803600 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.803759 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.803920 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.804084 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.804238 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.804389 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.804548 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.804702 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.804862 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.805022 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.805174 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.805333 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.805508 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.805660 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.805839 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.806062 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.806229 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.807329 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.807493 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.807657 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.807823 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.807984 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.808145 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.808305 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.808478 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.808725 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.808886 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.809037 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.809188 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.809339 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.809499 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.809660 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.809812 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.809964 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.810114 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.810264 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.810415 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.810595 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.810773 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.810773 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.811075 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.811075 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.811361 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.811525 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.811678 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.811988 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.812151 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.812417 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.812591 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.812744 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.812918 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.813080 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.813241 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.813401 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.813564 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.813564 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.813852 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.814003 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.814163 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.814327 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.814493 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.814737 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.814909 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.815072 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.815232 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.815384 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.815602 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.815765 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.815917 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.816086 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.816309 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.816476 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.816628 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.816792 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.816944 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.817094 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.817258 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.817528 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.817689 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.817842 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.817993 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.818143 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.818304 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.818466 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.818713 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.818938 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.819104 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.819264 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.819424 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.819598 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.819750 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.819901 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.820051 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.820210 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.820364 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.820528 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.820528 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.820824 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.821047 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.821200 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.821360 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.821524 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.821684 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.821843 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.822958 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.823135 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.823305 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.823458 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.823612 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.823771 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.823923 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.824074 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.824235 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.824394 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.824568 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.824721 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.824881 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.825042 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.825195 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.825376 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.825659 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.825844 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.826007 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.826185 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.826514 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.826693 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.826851 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.827030 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.827192 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.827344 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.827521 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.827788 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.827948 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.828114 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.828284 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.828439 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.828595 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.828748 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.828933 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.829189 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.829365 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.829543 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.829705 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.829866 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.830034 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.830187 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.830338 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.830488 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.830738 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.831009 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.831282 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.831673 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.831976 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.832265 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.832812 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.833166 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.833356 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.833632 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.833792 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.833945 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.834106 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.834274 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.834427 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.834580 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.834833 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.835105 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.835385 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.835681 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.835926 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.836180 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.836453 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.836844 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.837109 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.837387 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.837387 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.838059 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.838241 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.839060 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.839351 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.839514 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.839514 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.839802 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.839802 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.839802 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.839802 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.839802 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.839802 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.839802 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.839802 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.841572 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.841572 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.841572 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.841572 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.841572 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.842413 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.842413 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.842896 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.843072 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.843416 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.843699 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.844071 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.844355 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.844698 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.844986 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.845249 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.845479 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.845646 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.845812 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.845973 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.846134 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.846326 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.846495 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.846669 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.846933 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.847095 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.847290 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.847453 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.847613 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.847765 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.847925 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.848206 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.848206 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.848503 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.848653 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.848820 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.848972 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.849130 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.849281 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.849512 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.849676 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.849843 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.850003 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.850154 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.850305 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.850455 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.850614 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.850828 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.851052 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.851210 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.851369 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.851529 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.851692 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.851933 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.852087 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.852247 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.852407 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.852559 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.852818 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.852818 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.852818 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.853321 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.853647 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.853836 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.854019 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.854270 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.854437 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.854590 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.854779 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.854933 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.855099 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.855260 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.855411 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.855563 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.855722 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.855874 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.856035 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.856035 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.856342 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.856495 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.856645 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.856645 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.857039 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.857039 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.857337 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.857337 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.857641 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.857806 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.857965 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.858126 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.858395 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.858566 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.858798 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.858798 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.859107 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.859269 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.859421 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.859572 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.859722 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.859882 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.860035 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.860194 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.860347 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.860512 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.860663 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.860827 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.860980 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.861224 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.861411 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.862064 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.862243 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.862405 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.862557 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.862733 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.862991 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.863151 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.863401 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.863594 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.863831 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.863988 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.864147 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.864383 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.864558 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.864719 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.864878 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.865030 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.865194 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.865360 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.865513 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.865676 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.865828 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.865986 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.866149 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.866370 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.866553 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.866731 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.866882 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.867064 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.867297 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.867467 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.867622 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.867780 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.867943 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.868108 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.868448 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.868623 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.869347 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.869627 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.869820 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.870052 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.870270 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.870482 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.870798 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.871032 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.871262 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.871502 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.871669 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.871831 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.871983 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.872133 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.872291 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.872291 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.872599 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.872750 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.872910 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.873157 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.873157 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.873482 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.873641 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.873641 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.874029 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.874186 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.874186 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.874573 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.874762 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.874917 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.875068 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.875068 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.875371 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.875530 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.875703 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.875857 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.876015 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.876166 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.876166 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.876481 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.876632 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.876800 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.877041 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.877041 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.877534 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.877701 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.877701 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.878010 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.878171 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.878171 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.878473 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.878679 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.878849 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.879001 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.879001 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.879297 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.879449 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.879449 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.880085 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.880260 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.880422 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.880574 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.880574 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.880861 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.881020 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.881182 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.881353 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.881353 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.881752 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.881909 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.882068 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.882247 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.882247 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.882564 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.882742 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.882742 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.883029 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.883286 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.883455 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.883607 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.883766 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.883917 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.883917 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.884340 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.885431 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.885604 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.885604 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.885916 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.885916 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.886226 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.886380 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.887154 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.887323 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.887545 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.887796 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.887963 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.888124 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.888124 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.888442 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.888605 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.888757 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.888908 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.889066 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.889066 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.889365 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.889524 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.889706 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.889879 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.890167 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.890327 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.890478 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.890705 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.890864 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.891025 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.891187 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.891347 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.891499 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.891650 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.891931 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.892232 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.892419 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.892582 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.892744 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.892896 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.893047 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.893047 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.893460 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.893628 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.893782 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.893933 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.894083 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.894352 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.894538 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.894790 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.894964 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.895119 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.895277 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.895445 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.895604 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.895604 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.895901 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.896052 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.896203 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.896368 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.896521 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.896683 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.896834 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.896985 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.897136 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.897306 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.897459 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.897625 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.897897 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.898144 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.898317 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.898476 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.898656 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.898815 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.898979 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.899132 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.899296 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.899448 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.899599 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.899750 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.900187 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.900465 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.900636 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.900961 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.901131 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.901285 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.901701 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.901892 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.902126 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.902313 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.902469 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.902704 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.902875 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.903043 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.903229 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.903522 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.903693 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.903846 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.903997 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.903997 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.904335 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.904575 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.904742 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.904742 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.905159 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.905159 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.905463 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.905615 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.905772 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.905932 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.906159 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.906321 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.906494 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.906703 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.906863 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.907015 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.907178 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.907340 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.907493 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.907644 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.907795 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.907795 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.908124 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.908358 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.908516 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.908678 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.908830 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.908981 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.909142 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.909294 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.909454 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.909615 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.909768 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.909932 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.910085 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.910236 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.910394 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.910562 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.910845 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.911016 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.911178 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.911331 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.911483 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.911635 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.911787 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.911953 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.912125 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.912347 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.912347 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.912692 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.912864 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.913032 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.913185 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.913346 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.913507 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.913747 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.913920 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.914073 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.914224 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.914384 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.914552 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.914740 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.914906 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.915159 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.915319 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.915477 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.915630 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.916298 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.916516 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.916737 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.916908 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.917062 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.917213 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.917379 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.917531 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.917703 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.917869 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.918023 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.918023 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.918346 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.918577 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.918847 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.919002 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.919164 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.919326 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.919487 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.919640 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.919800 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.919964 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.920117 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.920277 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.920449 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.920627 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.920787 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.921050 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.921210 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.921210 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.921210 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.921210 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.921802 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.921973 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.922134 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.922296 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.922544 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.922733 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.922902 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.922902 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.923197 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.923370 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.923523 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.923675 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.923919 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.924087 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.924266 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.924420 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.924579 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.924742 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.924903 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.925064 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.925312 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.925485 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.925638 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.925798 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.925951 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.926116 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.926289 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.926451 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.926605 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.926811 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.926964 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.927132 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.927286 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.927439 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.927590 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.927749 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.927904 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.928111 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.928224 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.928325 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.928414 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.928500 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.928591 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.928674 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.928754 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.928754 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.928918 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.928918 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.929094 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.929180 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.929271 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.929363 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.929448 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.929538 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.929635 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.929734 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.929819 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.929909 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.929993 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.930076 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.930171 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.930265 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.930350 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.930433 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.930516 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.930611 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.930748 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.930824 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.930902 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.930980 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.931051 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.931135 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.931208 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.931327 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.931448 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.932055 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.932136 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.932223 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.932307 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.932388 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.932466 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.932538 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.932538 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.932682 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.932754 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.932824 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.932900 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.932971 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.933054 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.933126 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.933126 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.933259 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.933329 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.933398 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.933533 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.933621 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.933695 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.933773 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.933868 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.933955 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.934043 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.934136 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.934220 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.934304 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.934398 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.934496 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.934496 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.934680 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.934768 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.934851 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.934946 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.935041 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.935126 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.935209 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.935317 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.935390 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.935463 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.935542 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.935634 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.935719 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.935802 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.935883 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.935974 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.936067 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.936151 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.936241 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.936332 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.936415 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.936511 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.936595 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.936686 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.936777 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.936868 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.936951 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.937042 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.937133 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.937225 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.937316 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.937407 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.937491 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.937582 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.937673 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.937758 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 16 14:24:35.937841 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.937841 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.937841 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.937841 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.937841 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.937841 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.937841 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.937841 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.938449 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.938449 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.938449 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.938449 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.938449 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.938449 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.938449 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.938449 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.939546 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.939546 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.939546 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.939546 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.939546 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.939546 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.939546 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.939546 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.940130 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.940130 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.940130 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.940130 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.940130 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.940130 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.940130 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.940130 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.940737 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.940737 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.940737 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.940737 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.940737 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.940737 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.940737 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.940737 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.941345 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.941345 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.941345 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.941345 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.941345 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.941345 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.941345 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.941345 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.941960 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.941960 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.941960 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.942185 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.942336 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.942740 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.943546 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.943683 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.944005 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.944362 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.944695 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.945046 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.945355 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.945670 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.946110 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.946430 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.946778 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.947254 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.947628 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.947963 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.948298 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.948477 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_db.sqlalchemy.engines [None req-d8c3d1f5-34c2-46ce-9b94-e7a1341b7285 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117031) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 16 14:24:35.948618 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.948947 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.949266 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.949602 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.949951 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.950286 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.950636 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.950972 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.951292 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.951604 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.951920 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.952256 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.952598 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.952920 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.953252 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.953571 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.953906 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.954211 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.954540 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.954895 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.955221 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.955537 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.955876 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.956193 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.956511 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.956832 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.957148 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.957465 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.958035 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.958369 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.958732 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.959047 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.959415 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.959701 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.960028 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.960352 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.960672 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.961007 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.961330 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.961652 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.961970 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.962288 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.962705 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.962979 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.963312 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.963646 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.964011 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.964311 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.964663 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.964983 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.965335 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.965671 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.965990 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.966309 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.966640 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 16 14:24:35.966898 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 16 14:24:35.989652 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_db.sqlalchemy.engines [None req-c213c15d-8b35-4be8-8b5e-968506943b85 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117032) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 16 14:24:36.013153 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.context [None req-d8c3d1f5-34c2-46ce-9b94-e7a1341b7285 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d50d195e-47a1-45e7-9830-39e8ce60e8f3(cell1) {{(pid=117031) load_cells /opt/stack/nova/nova/context.py:464}} Feb 16 14:24:36.017386 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d8c3d1f5-34c2-46ce-9b94-e7a1341b7285 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:24:36.019005 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d8c3d1f5-34c2-46ce-9b94-e7a1341b7285 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:24:36.019814 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d8c3d1f5-34c2-46ce-9b94-e7a1341b7285 None None] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:24:36.021744 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d8c3d1f5-34c2-46ce-9b94-e7a1341b7285 None None] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:24:36.033447 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_db.sqlalchemy.engines [None req-d8c3d1f5-34c2-46ce-9b94-e7a1341b7285 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117031) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 16 14:24:36.033892 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_db.sqlalchemy.engines [None req-d8c3d1f5-34c2-46ce-9b94-e7a1341b7285 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117031) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 16 14:24:36.055132 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.context [None req-c213c15d-8b35-4be8-8b5e-968506943b85 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d50d195e-47a1-45e7-9830-39e8ce60e8f3(cell1) {{(pid=117032) load_cells /opt/stack/nova/nova/context.py:464}} Feb 16 14:24:36.060071 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c213c15d-8b35-4be8-8b5e-968506943b85 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:24:36.061676 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c213c15d-8b35-4be8-8b5e-968506943b85 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:24:36.062493 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c213c15d-8b35-4be8-8b5e-968506943b85 None None] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:24:36.064477 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c213c15d-8b35-4be8-8b5e-968506943b85 None None] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:24:36.074883 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_db.sqlalchemy.engines [None req-c213c15d-8b35-4be8-8b5e-968506943b85 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117032) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 16 14:24:36.076780 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_db.sqlalchemy.engines [None req-c213c15d-8b35-4be8-8b5e-968506943b85 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117032) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 16 14:24:36.194051 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_db.sqlalchemy.engines [None req-d8c3d1f5-34c2-46ce-9b94-e7a1341b7285 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117031) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 16 14:24:36.241335 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_db.sqlalchemy.engines [None req-c213c15d-8b35-4be8-8b5e-968506943b85 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117032) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 16 14:24:36.633902 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: WARNING keystonemiddleware.auth_token [None req-d8c3d1f5-34c2-46ce-9b94-e7a1341b7285 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 16 14:24:36.641683 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: WARNING keystonemiddleware.auth_token [None req-d8c3d1f5-34c2-46ce-9b94-e7a1341b7285 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 16 14:24:36.683502 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: WARNING keystonemiddleware.auth_token [None req-c213c15d-8b35-4be8-8b5e-968506943b85 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 16 14:24:36.690097 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: WARNING keystonemiddleware.auth_token [None req-c213c15d-8b35-4be8-8b5e-968506943b85 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 16 14:24:36.876351 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: WARNING keystonemiddleware.auth_token [None req-d8c3d1f5-34c2-46ce-9b94-e7a1341b7285 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 16 14:24:36.881636 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: WARNING keystonemiddleware.auth_token [None req-d8c3d1f5-34c2-46ce-9b94-e7a1341b7285 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 16 14:24:36.887520 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563af676f9c0 pid: 117031 (default app) Feb 16 14:24:36.919919 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: WARNING keystonemiddleware.auth_token [None req-c213c15d-8b35-4be8-8b5e-968506943b85 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 16 14:24:36.925142 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: WARNING keystonemiddleware.auth_token [None req-c213c15d-8b35-4be8-8b5e-968506943b85 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 16 14:24:36.930512 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563af676f9c0 pid: 117032 (default app) Feb 16 14:25:13.822705 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-b125e017-ff6c-4e08-b254-ee7e5d3423df tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] Action: 'create', calling method: .version_select at 0x7f2992db2af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1365622449"}} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:25:15.023294 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-83f5057d-02f2-49ce-a40c-b0548686c4b2 tempest-VolumesGetTestJSON-1207938396 tempest-VolumesGetTestJSON-1207938396-project] Action: 'create', calling method: .version_select at 0x7f2992db3af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1715050135", "metadata": {"Type": "work"}}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:25:16.174666 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-b125e017-ff6c-4e08-b254-ee7e5d3423df tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] 10.222.0.110 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.426890 Feb 16 14:25:16.175847 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 1/1] 10.222.0.110 () {60 vars in 1159 bytes} [Wed Feb 16 14:25:12 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3430 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Feb 16 14:25:16.188861 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-6562f043-6780-40dc-8e96-4d614d438701 tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] Calling method '.version_select at 0x7f2992c75670>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:16.452901 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-6562f043-6780-40dc-8e96-4d614d438701 tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] 10.222.0.110 "GET /compute/v2.1/os-volumes/6dcfa0d5-67a7-43d0-9e46-3b7025124190" status: 200 len: 345 microversion: 2.1 time: 0.265523 Feb 16 14:25:16.452901 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 2/2] 10.222.0.110 () {58 vars in 1249 bytes} [Wed Feb 16 14:25:16 2022] GET /compute/v2.1/os-volumes/6dcfa0d5-67a7-43d0-9e46-3b7025124190 => generated 345 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:25:16.930758 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-83f5057d-02f2-49ce-a40c-b0548686c4b2 tempest-VolumesGetTestJSON-1207938396 tempest-VolumesGetTestJSON-1207938396-project] 10.222.0.110 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.674113 Feb 16 14:25:16.932080 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 1/3] 10.222.0.110 () {60 vars in 1160 bytes} [Wed Feb 16 14:25:14 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2678 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Feb 16 14:25:16.943591 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-e85cafaf-1785-436d-9459-3c9cc68af962 tempest-VolumesGetTestJSON-1207938396 tempest-VolumesGetTestJSON-1207938396-project] Calling method '.version_select at 0x7f2992c75e50>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:17.010405 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-e85cafaf-1785-436d-9459-3c9cc68af962 tempest-VolumesGetTestJSON-1207938396 tempest-VolumesGetTestJSON-1207938396-project] 10.222.0.110 "GET /compute/v2.1/os-volumes/e3028e7b-4927-4b62-9660-c6e4c5212f99" status: 200 len: 353 microversion: 2.1 time: 0.068277 Feb 16 14:25:17.010405 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 3/4] 10.222.0.110 () {58 vars in 1249 bytes} [Wed Feb 16 14:25:16 2022] GET /compute/v2.1/os-volumes/e3028e7b-4927-4b62-9660-c6e4c5212f99 => generated 353 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:25:17.471235 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-8e368760-8697-4cbb-af68-d872b4aedb40 tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] Calling method '.version_select at 0x7f2992c900d0>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:17.482425 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-1684bed3-4830-4629-ab4a-e69a102cf9e5 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1694192380", "imageRef": "2493d2dc-e081-43d3-8292-91b4762a21e8", "flavorRef": "452", "networks": [{"uuid": "06af663a-d931-4d79-ac78-7b297e58e0fa"}]}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:25:17.582492 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-8e368760-8697-4cbb-af68-d872b4aedb40 tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] 10.222.0.110 "GET /compute/v2.1/os-volumes/6dcfa0d5-67a7-43d0-9e46-3b7025124190" status: 200 len: 345 microversion: 2.1 time: 0.115819 Feb 16 14:25:17.588041 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 4/5] 10.222.0.110 () {58 vars in 1249 bytes} [Wed Feb 16 14:25:17 2022] GET /compute/v2.1/os-volumes/6dcfa0d5-67a7-43d0-9e46-3b7025124190 => generated 345 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:25:17.611830 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.network.neutron [None req-1684bed3-4830-4629-ab4a-e69a102cf9e5 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] validate_networks() for [('06af663a-d931-4d79-ac78-7b297e58e0fa', None, None, None, None, None)] {{(pid=117032) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 16 14:25:18.022718 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-4b39d74b-9352-4364-8b17-3017fa5d6d22 tempest-VolumesGetTestJSON-1207938396 tempest-VolumesGetTestJSON-1207938396-project] Calling method '.version_select at 0x7f2992c90940>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:18.140472 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-4b39d74b-9352-4364-8b17-3017fa5d6d22 tempest-VolumesGetTestJSON-1207938396 tempest-VolumesGetTestJSON-1207938396-project] 10.222.0.110 "GET /compute/v2.1/os-volumes/e3028e7b-4927-4b62-9660-c6e4c5212f99" status: 200 len: 354 microversion: 2.1 time: 0.121467 Feb 16 14:25:18.141369 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 5/6] 10.222.0.110 () {58 vars in 1249 bytes} [Wed Feb 16 14:25:18 2022] GET /compute/v2.1/os-volumes/e3028e7b-4927-4b62-9660-c6e4c5212f99 => generated 354 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 14:25:18.163975 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-aa5ab596-4b31-42b3-91f9-c6ac9a4d9ea8 tempest-VolumesGetTestJSON-1207938396 tempest-VolumesGetTestJSON-1207938396-project] Calling method '.version_select at 0x7f2992c90dc0>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:18.264958 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-aa5ab596-4b31-42b3-91f9-c6ac9a4d9ea8 tempest-VolumesGetTestJSON-1207938396 tempest-VolumesGetTestJSON-1207938396-project] 10.222.0.110 "GET /compute/v2.1/os-volumes/e3028e7b-4927-4b62-9660-c6e4c5212f99" status: 200 len: 354 microversion: 2.1 time: 0.104751 Feb 16 14:25:18.273775 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 6/7] 10.222.0.110 () {58 vars in 1249 bytes} [Wed Feb 16 14:25:18 2022] GET /compute/v2.1/os-volumes/e3028e7b-4927-4b62-9660-c6e4c5212f99 => generated 354 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:25:18.287365 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-7dc9fb40-7250-42eb-aec5-d1b11cd2489b tempest-VolumesGetTestJSON-1207938396 tempest-VolumesGetTestJSON-1207938396-project] Calling method '.version_select at 0x7f2992c904c0>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:18.657665 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-7dc9fb40-7250-42eb-aec5-d1b11cd2489b tempest-VolumesGetTestJSON-1207938396 tempest-VolumesGetTestJSON-1207938396-project] 10.222.0.110 "DELETE /compute/v2.1/os-volumes/e3028e7b-4927-4b62-9660-c6e4c5212f99" status: 202 len: 0 microversion: 2.1 time: 0.379616 Feb 16 14:25:18.659086 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 7/8] 10.222.0.110 () {58 vars in 1252 bytes} [Wed Feb 16 14:25:18 2022] DELETE /compute/v2.1/os-volumes/e3028e7b-4927-4b62-9660-c6e4c5212f99 => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 14:25:18.669583 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-2e5b9d8d-2426-41d6-89b9-044ca8996e02 tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] Calling method '.version_select at 0x7f2992c758b0>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:18.728376 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-2e5b9d8d-2426-41d6-89b9-044ca8996e02 tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] 10.222.0.110 "GET /compute/v2.1/os-volumes/6dcfa0d5-67a7-43d0-9e46-3b7025124190" status: 200 len: 346 microversion: 2.1 time: 0.063700 Feb 16 14:25:18.729148 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 8/9] 10.222.0.110 () {58 vars in 1249 bytes} [Wed Feb 16 14:25:18 2022] GET /compute/v2.1/os-volumes/6dcfa0d5-67a7-43d0-9e46-3b7025124190 => generated 346 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:25:18.734589 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-e8c91949-2c7f-424c-b892-d0d98083e737 tempest-VolumesGetTestJSON-1207938396 tempest-VolumesGetTestJSON-1207938396-project] Calling method '.version_select at 0x7f2992c75e50>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:18.808874 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-e8c91949-2c7f-424c-b892-d0d98083e737 tempest-VolumesGetTestJSON-1207938396 tempest-VolumesGetTestJSON-1207938396-project] 10.222.0.110 "GET /compute/v2.1/os-volumes/e3028e7b-4927-4b62-9660-c6e4c5212f99" status: 200 len: 353 microversion: 2.1 time: 0.078587 Feb 16 14:25:18.809981 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 9/10] 10.222.0.110 () {58 vars in 1249 bytes} [Wed Feb 16 14:25:18 2022] GET /compute/v2.1/os-volumes/e3028e7b-4927-4b62-9660-c6e4c5212f99 => generated 353 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:25:18.820424 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-f576076a-fda1-49d0-8132-39bf2a99e141 tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] Action: 'create', calling method: .version_select at 0x7f2992c90160>, body: {"snapshot": {"volume_id": "6dcfa0d5-67a7-43d0-9e46-3b7025124190", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1579735695"}} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:25:19.523346 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-f576076a-fda1-49d0-8132-39bf2a99e141 tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] 10.222.0.110 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.711938 Feb 16 14:25:19.524042 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 10/11] 10.222.0.110 () {60 vars in 1166 bytes} [Wed Feb 16 14:25:18 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:25:19.533869 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-a601552e-12c0-49a5-9492-1098e3fa45f8 tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] Calling method '.version_select at 0x7f2992c90ca0>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:19.673583 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-a601552e-12c0-49a5-9492-1098e3fa45f8 tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] 10.222.0.110 "GET /compute/v2.1/os-snapshots/6554cd57-352f-4b30-921d-0d7c14e1d0ca" status: 200 len: 287 microversion: 2.1 time: 0.143309 Feb 16 14:25:19.685278 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 11/12] 10.222.0.110 () {58 vars in 1255 bytes} [Wed Feb 16 14:25:19 2022] GET /compute/v2.1/os-snapshots/6554cd57-352f-4b30-921d-0d7c14e1d0ca => generated 287 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 14:25:19.687085 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-b862c08b-d764-4267-9f10-53bcfdefb5c8 tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] Calling method '.version_select at 0x7f2992c90f70>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:19.777896 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-b862c08b-d764-4267-9f10-53bcfdefb5c8 tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] 10.222.0.110 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.094668 Feb 16 14:25:19.778773 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 12/13] 10.222.0.110 () {58 vars in 1144 bytes} [Wed Feb 16 14:25:19 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:25:19.790320 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-3653146b-ba39-4489-93c4-ec9a4fdbf54d tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] Calling method '.version_select at 0x7f2992c75700>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:19.852659 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-3653146b-ba39-4489-93c4-ec9a4fdbf54d tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] 10.222.0.110 "GET /compute/v2.1/os-snapshots/6554cd57-352f-4b30-921d-0d7c14e1d0ca" status: 200 len: 287 microversion: 2.1 time: 0.067193 Feb 16 14:25:19.854673 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 13/14] 10.222.0.110 () {58 vars in 1255 bytes} [Wed Feb 16 14:25:19 2022] GET /compute/v2.1/os-snapshots/6554cd57-352f-4b30-921d-0d7c14e1d0ca => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:25:19.862244 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-81cfe0ed-ffa0-4d28-958a-ed79d37b33a2 tempest-VolumesGetTestJSON-1207938396 tempest-VolumesGetTestJSON-1207938396-project] Calling method '.version_select at 0x7f2992ca5160>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:19.920551 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.wsgi [None req-81cfe0ed-ffa0-4d28-958a-ed79d37b33a2 tempest-VolumesGetTestJSON-1207938396 tempest-VolumesGetTestJSON-1207938396-project] HTTP exception thrown: Volume e3028e7b-4927-4b62-9660-c6e4c5212f99 could not be found. Feb 16 14:25:19.921203 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-81cfe0ed-ffa0-4d28-958a-ed79d37b33a2 tempest-VolumesGetTestJSON-1207938396 tempest-VolumesGetTestJSON-1207938396-project] Returning 404 to user: Volume e3028e7b-4927-4b62-9660-c6e4c5212f99 could not be found. {{(pid=117031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:25:19.922053 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-81cfe0ed-ffa0-4d28-958a-ed79d37b33a2 tempest-VolumesGetTestJSON-1207938396 tempest-VolumesGetTestJSON-1207938396-project] 10.222.0.110 "GET /compute/v2.1/os-volumes/e3028e7b-4927-4b62-9660-c6e4c5212f99" status: 404 len: 109 microversion: 2.1 time: 0.066168 Feb 16 14:25:19.922610 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 14/15] 10.222.0.110 () {58 vars in 1249 bytes} [Wed Feb 16 14:25:19 2022] GET /compute/v2.1/os-volumes/e3028e7b-4927-4b62-9660-c6e4c5212f99 => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 14:25:20.085496 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-1684bed3-4830-4629-ab4a-e69a102cf9e5 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Flavor limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 16 14:25:20.088100 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-1684bed3-4830-4629-ab4a-e69a102cf9e5 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Image limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 16 14:25:20.088926 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-1684bed3-4830-4629-ab4a-e69a102cf9e5 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Flavor pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 16 14:25:20.089986 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-1684bed3-4830-4629-ab4a-e69a102cf9e5 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Image pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 16 14:25:20.090869 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-1684bed3-4830-4629-ab4a-e69a102cf9e5 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 16 14:25:20.109122 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1684bed3-4830-4629-ab4a-e69a102cf9e5 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:20.109989 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1684bed3-4830-4629-ab4a-e69a102cf9e5 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:20.111464 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1684bed3-4830-4629-ab4a-e69a102cf9e5 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:20.112203 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1684bed3-4830-4629-ab4a-e69a102cf9e5 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:20.160262 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-1684bed3-4830-4629-ab4a-e69a102cf9e5 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Getting quotas for project 04d38e42748249e495e0d4f675a018a8. Resources: {'cores', 'instances', 'ram'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 14:25:20.171295 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-1684bed3-4830-4629-ab4a-e69a102cf9e5 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Getting quotas for user d701d137d5744a3ea6b17a8568da17c9 and project 04d38e42748249e495e0d4f675a018a8. Resources: {'cores', 'instances', 'ram'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 14:25:20.188053 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-1684bed3-4830-4629-ab4a-e69a102cf9e5 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Going to run 1 instances... {{(pid=117032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 16 14:25:20.192149 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-1684bed3-4830-4629-ab4a-e69a102cf9e5 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2493d2dc-e081-43d3-8292-91b4762a21e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 16 14:25:20.443745 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-1684bed3-4830-4629-ab4a-e69a102cf9e5 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 3.059783 Feb 16 14:25:20.445299 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 2/16] 10.222.0.110 () {60 vars in 1151 bytes} [Wed Feb 16 14:25:17 2022] POST /compute/v2.1/servers => generated 382 bytes in 3063 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Feb 16 14:25:20.456190 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-99e49b83-7001-454b-8d99-104c86db2aec tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:20.457536 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-99e49b83-7001-454b-8d99-104c86db2aec tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:20.844893 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-99e49b83-7001-454b-8d99-104c86db2aec tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd701d137d5744a3ea6b17a8568da17c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d38e42748249e495e0d4f675a018a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:20.865403 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-99e49b83-7001-454b-8d99-104c86db2aec tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 200 len: 1219 microversion: 2.1 time: 0.412815 Feb 16 14:25:20.865991 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 15/17] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:20 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 1219 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:20.867820 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e1ffc6fe-a897-4cef-a579-8cd527ba2796 tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] Calling method '.version_select at 0x7f2992c0dca0>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:20.940912 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-e1ffc6fe-a897-4cef-a579-8cd527ba2796 tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] 10.222.0.110 "GET /compute/v2.1/os-snapshots/6554cd57-352f-4b30-921d-0d7c14e1d0ca" status: 200 len: 287 microversion: 2.1 time: 0.078116 Feb 16 14:25:20.945222 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 3/18] 10.222.0.110 () {58 vars in 1255 bytes} [Wed Feb 16 14:25:20 2022] GET /compute/v2.1/os-snapshots/6554cd57-352f-4b30-921d-0d7c14e1d0ca => generated 287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:25:21.882897 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-7ce003f4-fb6d-405a-a593-ce90d9067754 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:21.884316 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-7ce003f4-fb6d-405a-a593-ce90d9067754 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:21.952637 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f0466ad2-3df1-4bbb-9f4f-776df0038092 tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] Calling method '.version_select at 0x7f2992ba4af0>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:22.016195 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f0466ad2-3df1-4bbb-9f4f-776df0038092 tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] 10.222.0.110 "GET /compute/v2.1/os-snapshots/6554cd57-352f-4b30-921d-0d7c14e1d0ca" status: 200 len: 287 microversion: 2.1 time: 0.067545 Feb 16 14:25:22.016776 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 4/19] 10.222.0.110 () {58 vars in 1255 bytes} [Wed Feb 16 14:25:21 2022] GET /compute/v2.1/os-snapshots/6554cd57-352f-4b30-921d-0d7c14e1d0ca => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 14:25:22.258779 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-7ce003f4-fb6d-405a-a593-ce90d9067754 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd701d137d5744a3ea6b17a8568da17c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d38e42748249e495e0d4f675a018a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:22.285995 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-7ce003f4-fb6d-405a-a593-ce90d9067754 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 200 len: 1219 microversion: 2.1 time: 0.394157 Feb 16 14:25:22.285995 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 16/20] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:21 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 1219 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:23.032801 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-cc97db4d-bb5c-4e68-8669-94d66a727020 tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] Calling method '.version_select at 0x7f2992c0dca0>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:23.106504 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-cc97db4d-bb5c-4e68-8669-94d66a727020 tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] 10.222.0.110 "GET /compute/v2.1/os-snapshots/6554cd57-352f-4b30-921d-0d7c14e1d0ca" status: 200 len: 287 microversion: 2.1 time: 0.080793 Feb 16 14:25:23.116080 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 5/21] 10.222.0.110 () {58 vars in 1255 bytes} [Wed Feb 16 14:25:23 2022] GET /compute/v2.1/os-snapshots/6554cd57-352f-4b30-921d-0d7c14e1d0ca => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:25:23.297591 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-dc54bcbe-d18a-4f96-afd2-104676e81752 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:23.298803 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-dc54bcbe-d18a-4f96-afd2-104676e81752 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:23.309666 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-dc54bcbe-d18a-4f96-afd2-104676e81752 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:23.310166 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-dc54bcbe-d18a-4f96-afd2-104676e81752 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:23.311151 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-dc54bcbe-d18a-4f96-afd2-104676e81752 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:23.315722 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-dc54bcbe-d18a-4f96-afd2-104676e81752 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:23.771584 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-dc54bcbe-d18a-4f96-afd2-104676e81752 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd701d137d5744a3ea6b17a8568da17c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d38e42748249e495e0d4f675a018a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:23.824221 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-dc54bcbe-d18a-4f96-afd2-104676e81752 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 200 len: 1223 microversion: 2.1 time: 0.519890 Feb 16 14:25:23.827143 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 17/22] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:23 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 1223 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:24.119892 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-19fdbf96-bcb3-4ea4-aea0-fd5b0930dab2 tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] Calling method '.version_select at 0x7f2992ba4700>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:24.161894 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-19fdbf96-bcb3-4ea4-aea0-fd5b0930dab2 tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] 10.222.0.110 "GET /compute/v2.1/os-snapshots/6554cd57-352f-4b30-921d-0d7c14e1d0ca" status: 200 len: 288 microversion: 2.1 time: 0.046755 Feb 16 14:25:24.182355 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 6/23] 10.222.0.110 () {58 vars in 1255 bytes} [Wed Feb 16 14:25:24 2022] GET /compute/v2.1/os-snapshots/6554cd57-352f-4b30-921d-0d7c14e1d0ca => generated 288 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:25:24.182728 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-a5596cf8-fb2a-4fd6-b600-586a065f3d99 tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] Calling method '.version_select at 0x7f2992bd9e50>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:24.386668 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-a5596cf8-fb2a-4fd6-b600-586a065f3d99 tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] 10.222.0.110 "DELETE /compute/v2.1/os-snapshots/6554cd57-352f-4b30-921d-0d7c14e1d0ca" status: 202 len: 0 microversion: 2.1 time: 0.208843 Feb 16 14:25:24.386668 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 18/24] 10.222.0.110 () {58 vars in 1258 bytes} [Wed Feb 16 14:25:24 2022] DELETE /compute/v2.1/os-snapshots/6554cd57-352f-4b30-921d-0d7c14e1d0ca => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 14:25:24.393834 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-40662d1b-cc9b-4ef8-9e18-2f3b8d756302 tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] Calling method '.version_select at 0x7f2991b30160>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:24.506495 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-40662d1b-cc9b-4ef8-9e18-2f3b8d756302 tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] 10.222.0.110 "GET /compute/v2.1/os-snapshots/6554cd57-352f-4b30-921d-0d7c14e1d0ca" status: 200 len: 287 microversion: 2.1 time: 0.116935 Feb 16 14:25:24.512720 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 7/25] 10.222.0.110 () {58 vars in 1255 bytes} [Wed Feb 16 14:25:24 2022] GET /compute/v2.1/os-snapshots/6554cd57-352f-4b30-921d-0d7c14e1d0ca => generated 287 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:25:24.835006 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-7ecd8386-2318-4df8-9dfe-f21f698488ee tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:24.835608 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-7ecd8386-2318-4df8-9dfe-f21f698488ee tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:24.847927 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7ecd8386-2318-4df8-9dfe-f21f698488ee tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:24.852101 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7ecd8386-2318-4df8-9dfe-f21f698488ee tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:24.853000 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7ecd8386-2318-4df8-9dfe-f21f698488ee tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:24.853377 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7ecd8386-2318-4df8-9dfe-f21f698488ee tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:25.170074 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-7ecd8386-2318-4df8-9dfe-f21f698488ee tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd701d137d5744a3ea6b17a8568da17c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d38e42748249e495e0d4f675a018a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:25.173903 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e8853f6c-9c4a-464a-980d-bbd67cdcf3cb tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Action: 'create', calling method: .version_select at 0x7f2992b96ee0>, body: {"keypair": {"name": "tempest-keypair-74248194"}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:25:25.183043 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-7ecd8386-2318-4df8-9dfe-f21f698488ee tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 200 len: 1215 microversion: 2.1 time: 0.352545 Feb 16 14:25:25.200186 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 19/26] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:24 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 1215 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:25.215748 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-e8853f6c-9c4a-464a-980d-bbd67cdcf3cb tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Getting quotas for project d48b56501b0a49829c4522b171dd1159. Resources: {'key_pairs'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 14:25:25.221081 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-e8853f6c-9c4a-464a-980d-bbd67cdcf3cb tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Getting quotas for user bdbb57cd56c5450aacce437150585ea0 and project d48b56501b0a49829c4522b171dd1159. Resources: {'key_pairs'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 14:25:25.522328 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-32f8c1de-593b-4aef-8613-cf65f01710bf tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] Calling method '.version_select at 0x7f2992be4820>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:25.600501 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-32f8c1de-593b-4aef-8613-cf65f01710bf tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] 10.222.0.110 "GET /compute/v2.1/os-snapshots/6554cd57-352f-4b30-921d-0d7c14e1d0ca" status: 200 len: 287 microversion: 2.1 time: 0.083824 Feb 16 14:25:25.607855 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 20/27] 10.222.0.110 () {58 vars in 1255 bytes} [Wed Feb 16 14:25:25 2022] GET /compute/v2.1/os-snapshots/6554cd57-352f-4b30-921d-0d7c14e1d0ca => generated 287 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:25:25.660267 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-e8853f6c-9c4a-464a-980d-bbd67cdcf3cb tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Getting quotas for project d48b56501b0a49829c4522b171dd1159. Resources: {'key_pairs'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 14:25:25.672270 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-e8853f6c-9c4a-464a-980d-bbd67cdcf3cb tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Getting quotas for user bdbb57cd56c5450aacce437150585ea0 and project d48b56501b0a49829c4522b171dd1159. Resources: {'key_pairs'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 14:25:25.714603 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-e8853f6c-9c4a-464a-980d-bbd67cdcf3cb tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "POST /compute/v2.1/os-keypairs" status: 200 len: 2303 microversion: 2.1 time: 0.738621 Feb 16 14:25:25.715419 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 8/28] 10.222.0.110 () {60 vars in 1162 bytes} [Wed Feb 16 14:25:24 2022] POST /compute/v2.1/os-keypairs => generated 2303 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:25:26.210806 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-3ffed7e8-8d5f-49b5-a974-f51b42aef984 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:26.212533 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-3ffed7e8-8d5f-49b5-a974-f51b42aef984 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:26.225104 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3ffed7e8-8d5f-49b5-a974-f51b42aef984 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:26.227089 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3ffed7e8-8d5f-49b5-a974-f51b42aef984 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:26.228174 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3ffed7e8-8d5f-49b5-a974-f51b42aef984 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:26.231213 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3ffed7e8-8d5f-49b5-a974-f51b42aef984 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:26.388960 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-3ffed7e8-8d5f-49b5-a974-f51b42aef984 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd701d137d5744a3ea6b17a8568da17c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d38e42748249e495e0d4f675a018a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:26.396460 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-3ffed7e8-8d5f-49b5-a974-f51b42aef984 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 200 len: 1215 microversion: 2.1 time: 0.191123 Feb 16 14:25:26.406874 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 21/29] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:26 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 1215 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:26.613276 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6d0f5c80-8c9c-420b-84ba-792f07d15a53 tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] Calling method '.version_select at 0x7f2992ba4c10>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:26.658893 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-6d0f5c80-8c9c-420b-84ba-792f07d15a53 tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] 10.222.0.110 "GET /compute/v2.1/os-snapshots/6554cd57-352f-4b30-921d-0d7c14e1d0ca" status: 200 len: 287 microversion: 2.1 time: 0.049181 Feb 16 14:25:26.660091 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 9/30] 10.222.0.110 () {58 vars in 1255 bytes} [Wed Feb 16 14:25:26 2022] GET /compute/v2.1/os-snapshots/6554cd57-352f-4b30-921d-0d7c14e1d0ca => generated 287 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:25:27.417149 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-821f054b-8084-47b9-849c-868c26c52d97 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:27.418454 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-821f054b-8084-47b9-849c-868c26c52d97 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:27.430371 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-821f054b-8084-47b9-849c-868c26c52d97 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:27.431539 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-821f054b-8084-47b9-849c-868c26c52d97 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:27.432848 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-821f054b-8084-47b9-849c-868c26c52d97 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:27.433478 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-821f054b-8084-47b9-849c-868c26c52d97 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:27.585899 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-821f054b-8084-47b9-849c-868c26c52d97 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd701d137d5744a3ea6b17a8568da17c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d38e42748249e495e0d4f675a018a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:27.612294 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-821f054b-8084-47b9-849c-868c26c52d97 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 200 len: 1271 microversion: 2.1 time: 0.198529 Feb 16 14:25:27.618079 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 22/31] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:27 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 1271 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:27.676743 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-cb06972e-0091-4dc9-8fd3-2c73924597cd tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] Calling method '.version_select at 0x7f2992b95dc0>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:27.705045 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-19c36731-d1d0-4768-b74a-f8d462248cfc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Action: 'create', calling method: .version_select at 0x7f2991b571f0>, body: {"keypair": {"name": "tempest-keypair-50919512"}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:25:27.715504 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.wsgi [None req-cb06972e-0091-4dc9-8fd3-2c73924597cd tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] HTTP exception thrown: Snapshot 6554cd57-352f-4b30-921d-0d7c14e1d0ca could not be found. Feb 16 14:25:27.721163 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-cb06972e-0091-4dc9-8fd3-2c73924597cd tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] Returning 404 to user: Snapshot 6554cd57-352f-4b30-921d-0d7c14e1d0ca could not be found. {{(pid=117031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:25:27.722222 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-cb06972e-0091-4dc9-8fd3-2c73924597cd tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] 10.222.0.110 "GET /compute/v2.1/os-snapshots/6554cd57-352f-4b30-921d-0d7c14e1d0ca" status: 404 len: 111 microversion: 2.1 time: 0.054853 Feb 16 14:25:27.722924 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 23/32] 10.222.0.110 () {58 vars in 1255 bytes} [Wed Feb 16 14:25:27 2022] GET /compute/v2.1/os-snapshots/6554cd57-352f-4b30-921d-0d7c14e1d0ca => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 14:25:27.730207 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-19c36731-d1d0-4768-b74a-f8d462248cfc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Getting quotas for project aeb2105b246e4f78bccf81a39b007f69. Resources: {'key_pairs'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 14:25:27.733620 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-ab07132c-5d93-401e-8dea-14c31924891d tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] Calling method '.version_select at 0x7f29936193a0>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:27.744573 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-19c36731-d1d0-4768-b74a-f8d462248cfc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Getting quotas for user 745ca4a19a674037b9fee7f3778c05eb and project aeb2105b246e4f78bccf81a39b007f69. Resources: {'key_pairs'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 14:25:28.066280 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-ab07132c-5d93-401e-8dea-14c31924891d tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] 10.222.0.110 "DELETE /compute/v2.1/os-volumes/6dcfa0d5-67a7-43d0-9e46-3b7025124190" status: 202 len: 0 microversion: 2.1 time: 0.338162 Feb 16 14:25:28.067031 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 24/33] 10.222.0.110 () {58 vars in 1252 bytes} [Wed Feb 16 14:25:27 2022] DELETE /compute/v2.1/os-volumes/6dcfa0d5-67a7-43d0-9e46-3b7025124190 => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 14:25:28.078526 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-9d327daa-e98a-42ec-9322-cf1c226e98b3 tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] Calling method '.version_select at 0x7f2992bd9c10>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:28.163437 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-19c36731-d1d0-4768-b74a-f8d462248cfc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Getting quotas for project aeb2105b246e4f78bccf81a39b007f69. Resources: {'key_pairs'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 14:25:28.179980 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-19c36731-d1d0-4768-b74a-f8d462248cfc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Getting quotas for user 745ca4a19a674037b9fee7f3778c05eb and project aeb2105b246e4f78bccf81a39b007f69. Resources: {'key_pairs'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 14:25:28.229001 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-19c36731-d1d0-4768-b74a-f8d462248cfc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "POST /compute/v2.1/os-keypairs" status: 201 len: 2318 microversion: 2.20 time: 0.745428 Feb 16 14:25:28.235748 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 10/34] 10.222.0.110 () {62 vars in 1203 bytes} [Wed Feb 16 14:25:27 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 756 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Feb 16 14:25:28.240486 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-0de4ee1b-706c-4f65-8dcb-aa1bfc98e867 tempest-VolumesTestJSON-919716079 tempest-VolumesTestJSON-919716079-project] Calling method '.version_select at 0x7f2991b57d30>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:28.253260 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-9d327daa-e98a-42ec-9322-cf1c226e98b3 tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] 10.222.0.110 "GET /compute/v2.1/os-volumes/6dcfa0d5-67a7-43d0-9e46-3b7025124190" status: 200 len: 345 microversion: 2.1 time: 0.180974 Feb 16 14:25:28.263321 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 25/35] 10.222.0.110 () {58 vars in 1249 bytes} [Wed Feb 16 14:25:28 2022] GET /compute/v2.1/os-volumes/6dcfa0d5-67a7-43d0-9e46-3b7025124190 => generated 345 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:25:28.364513 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-0de4ee1b-706c-4f65-8dcb-aa1bfc98e867 tempest-VolumesTestJSON-919716079 tempest-VolumesTestJSON-919716079-project] 10.222.0.110 "GET /compute/v2.1/os-volumes/e2f80c56-ca68-4851-bb2c-f00a7fa461de" status: 200 len: 351 microversion: 2.1 time: 0.127494 Feb 16 14:25:28.365154 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 11/36] 10.222.0.110 () {58 vars in 1249 bytes} [Wed Feb 16 14:25:28 2022] GET /compute/v2.1/os-volumes/e2f80c56-ca68-4851-bb2c-f00a7fa461de => generated 351 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:25:28.632284 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-3615fd77-de62-4907-9ba5-7c2d9e43721a tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:28.633574 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-3615fd77-de62-4907-9ba5-7c2d9e43721a tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:28.645605 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3615fd77-de62-4907-9ba5-7c2d9e43721a tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:28.646325 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3615fd77-de62-4907-9ba5-7c2d9e43721a tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:28.647334 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3615fd77-de62-4907-9ba5-7c2d9e43721a tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:28.649912 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3615fd77-de62-4907-9ba5-7c2d9e43721a tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:28.786004 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-3615fd77-de62-4907-9ba5-7c2d9e43721a tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd701d137d5744a3ea6b17a8568da17c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d38e42748249e495e0d4f675a018a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:28.816478 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-3615fd77-de62-4907-9ba5-7c2d9e43721a tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 200 len: 1277 microversion: 2.1 time: 0.188772 Feb 16 14:25:28.826269 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 26/37] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:28 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 1277 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:29.269699 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-623aa3a2-4cd3-48c4-938e-fb2a9f5b7ec9 tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] Calling method '.version_select at 0x7f2992b2d940>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:29.324154 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.wsgi [None req-623aa3a2-4cd3-48c4-938e-fb2a9f5b7ec9 tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] HTTP exception thrown: Volume 6dcfa0d5-67a7-43d0-9e46-3b7025124190 could not be found. Feb 16 14:25:29.324750 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-623aa3a2-4cd3-48c4-938e-fb2a9f5b7ec9 tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] Returning 404 to user: Volume 6dcfa0d5-67a7-43d0-9e46-3b7025124190 could not be found. {{(pid=117031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:25:29.326811 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-623aa3a2-4cd3-48c4-938e-fb2a9f5b7ec9 tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] 10.222.0.110 "GET /compute/v2.1/os-volumes/6dcfa0d5-67a7-43d0-9e46-3b7025124190" status: 404 len: 109 microversion: 2.1 time: 0.062706 Feb 16 14:25:29.326811 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 27/38] 10.222.0.110 () {58 vars in 1249 bytes} [Wed Feb 16 14:25:29 2022] GET /compute/v2.1/os-volumes/6dcfa0d5-67a7-43d0-9e46-3b7025124190 => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 14:25:29.361672 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-df293a4e-a42b-4dab-a3d4-c73d3433b524 tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] Calling method '.version_select at 0x7f2992c75b80>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:29.427184 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.wsgi [None req-df293a4e-a42b-4dab-a3d4-c73d3433b524 tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] HTTP exception thrown: Volume 6dcfa0d5-67a7-43d0-9e46-3b7025124190 could not be found. Feb 16 14:25:29.427698 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-df293a4e-a42b-4dab-a3d4-c73d3433b524 tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] Returning 404 to user: Volume 6dcfa0d5-67a7-43d0-9e46-3b7025124190 could not be found. {{(pid=117031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:25:29.433371 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-df293a4e-a42b-4dab-a3d4-c73d3433b524 tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] 10.222.0.110 "DELETE /compute/v2.1/os-volumes/6dcfa0d5-67a7-43d0-9e46-3b7025124190" status: 404 len: 109 microversion: 2.1 time: 0.088410 Feb 16 14:25:29.434314 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 28/39] 10.222.0.110 () {58 vars in 1252 bytes} [Wed Feb 16 14:25:29 2022] DELETE /compute/v2.1/os-volumes/6dcfa0d5-67a7-43d0-9e46-3b7025124190 => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 14:25:29.442966 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-edaf17aa-965d-458f-8df8-c7b9d4beb6c0 tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] Calling method '.version_select at 0x7f2992bd9dc0>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:29.471953 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-cda69be0-c507-4131-81bb-a3a5e2901adc tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-259909092", "imageRef": "2493d2dc-e081-43d3-8292-91b4762a21e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:25:29.721649 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.wsgi [None req-edaf17aa-965d-458f-8df8-c7b9d4beb6c0 tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] HTTP exception thrown: Volume 6dcfa0d5-67a7-43d0-9e46-3b7025124190 could not be found. Feb 16 14:25:29.721649 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-edaf17aa-965d-458f-8df8-c7b9d4beb6c0 tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] Returning 404 to user: Volume 6dcfa0d5-67a7-43d0-9e46-3b7025124190 could not be found. {{(pid=117031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:25:29.721649 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-edaf17aa-965d-458f-8df8-c7b9d4beb6c0 tempest-VolumesSnapshotsTestJSON-254848258 tempest-VolumesSnapshotsTestJSON-254848258-project] 10.222.0.110 "GET /compute/v2.1/os-volumes/6dcfa0d5-67a7-43d0-9e46-3b7025124190" status: 404 len: 109 microversion: 2.1 time: 0.067405 Feb 16 14:25:29.721649 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 29/40] 10.222.0.110 () {58 vars in 1249 bytes} [Wed Feb 16 14:25:29 2022] GET /compute/v2.1/os-volumes/6dcfa0d5-67a7-43d0-9e46-3b7025124190 => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 14:25:29.724798 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.network.neutron [None req-cda69be0-c507-4131-81bb-a3a5e2901adc tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] validate_networks() for [('4ba8543b-8e56-4793-9ca0-86543e7d7d00', None, None, None, None, None)] {{(pid=117032) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 16 14:25:29.835645 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-f5b5391e-d487-43f5-84c4-cfc98bd6115a tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:29.837130 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-f5b5391e-d487-43f5-84c4-cfc98bd6115a tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:29.856323 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f5b5391e-d487-43f5-84c4-cfc98bd6115a tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:29.858059 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f5b5391e-d487-43f5-84c4-cfc98bd6115a tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:29.861827 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f5b5391e-d487-43f5-84c4-cfc98bd6115a tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:29.863938 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f5b5391e-d487-43f5-84c4-cfc98bd6115a tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:30.272276 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-f5b5391e-d487-43f5-84c4-cfc98bd6115a tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd701d137d5744a3ea6b17a8568da17c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d38e42748249e495e0d4f675a018a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:30.283338 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-f5b5391e-d487-43f5-84c4-cfc98bd6115a tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 200 len: 1277 microversion: 2.1 time: 0.452370 Feb 16 14:25:30.285192 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 30/41] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:29 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 1277 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:25:30.448449 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-e76fb492-6522-444b-9a11-95260444bc80 tempest-VolumesTestJSON-919716079 tempest-VolumesTestJSON-919716079-project] Calling method '.version_select at 0x7f2992b2d9d0>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:30.660757 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-e76fb492-6522-444b-9a11-95260444bc80 tempest-VolumesTestJSON-919716079 tempest-VolumesTestJSON-919716079-project] 10.222.0.110 "GET /compute/v2.1/os-volumes/1dfea556-3dba-4171-8aaa-43b3f30f34bc" status: 200 len: 350 microversion: 2.1 time: 0.217252 Feb 16 14:25:30.667033 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 31/42] 10.222.0.110 () {58 vars in 1249 bytes} [Wed Feb 16 14:25:30 2022] GET /compute/v2.1/os-volumes/1dfea556-3dba-4171-8aaa-43b3f30f34bc => generated 350 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:25:31.307985 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-cecd81fe-2ccf-4c6b-937a-c6de9e071849 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:31.308601 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-cecd81fe-2ccf-4c6b-937a-c6de9e071849 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:31.317538 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-cecd81fe-2ccf-4c6b-937a-c6de9e071849 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:31.317986 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-cecd81fe-2ccf-4c6b-937a-c6de9e071849 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:31.324127 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-cecd81fe-2ccf-4c6b-937a-c6de9e071849 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:31.348158 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-cecd81fe-2ccf-4c6b-937a-c6de9e071849 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:32.130766 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-cecd81fe-2ccf-4c6b-937a-c6de9e071849 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd701d137d5744a3ea6b17a8568da17c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d38e42748249e495e0d4f675a018a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:32.141702 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-cecd81fe-2ccf-4c6b-937a-c6de9e071849 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 200 len: 1277 microversion: 2.1 time: 0.843373 Feb 16 14:25:32.169970 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 32/43] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:31 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 1277 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:32.979151 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-cda69be0-c507-4131-81bb-a3a5e2901adc tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Flavor limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 16 14:25:32.980459 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-cda69be0-c507-4131-81bb-a3a5e2901adc tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Image limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 16 14:25:32.981175 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-cda69be0-c507-4131-81bb-a3a5e2901adc tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Flavor pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 16 14:25:32.981811 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-cda69be0-c507-4131-81bb-a3a5e2901adc tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Image pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 16 14:25:32.982436 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-cda69be0-c507-4131-81bb-a3a5e2901adc tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 16 14:25:32.998887 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cda69be0-c507-4131-81bb-a3a5e2901adc tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:33.000968 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cda69be0-c507-4131-81bb-a3a5e2901adc tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:33.002157 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cda69be0-c507-4131-81bb-a3a5e2901adc tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:33.003052 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cda69be0-c507-4131-81bb-a3a5e2901adc tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:33.029279 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-cda69be0-c507-4131-81bb-a3a5e2901adc tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Getting quotas for project bf4ddcdf7f0a469fa577164b86beb7cf. Resources: {'cores', 'instances', 'ram'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 14:25:33.036008 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-cda69be0-c507-4131-81bb-a3a5e2901adc tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Getting quotas for user d0b7c9898884449ca201f16f583baa21 and project bf4ddcdf7f0a469fa577164b86beb7cf. Resources: {'cores', 'instances', 'ram'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 14:25:33.058805 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-cda69be0-c507-4131-81bb-a3a5e2901adc tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Going to run 1 instances... {{(pid=117032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 16 14:25:33.061513 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-cda69be0-c507-4131-81bb-a3a5e2901adc tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2493d2dc-e081-43d3-8292-91b4762a21e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 16 14:25:33.168008 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-9e2695ec-d467-4d77-a426-3e991d369828 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:33.169483 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-9e2695ec-d467-4d77-a426-3e991d369828 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:33.178374 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9e2695ec-d467-4d77-a426-3e991d369828 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:33.183428 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9e2695ec-d467-4d77-a426-3e991d369828 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:33.184699 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9e2695ec-d467-4d77-a426-3e991d369828 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:33.185365 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9e2695ec-d467-4d77-a426-3e991d369828 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:33.191087 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-cda69be0-c507-4131-81bb-a3a5e2901adc tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 4.423922 Feb 16 14:25:33.193661 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 12/44] 10.222.0.110 () {60 vars in 1151 bytes} [Wed Feb 16 14:25:28 2022] POST /compute/v2.1/servers => generated 385 bytes in 4427 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Feb 16 14:25:33.213962 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-af65ca5a-7ca2-4292-a507-33bec38757bd tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:33.215326 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-af65ca5a-7ca2-4292-a507-33bec38757bd tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:33.539144 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-af65ca5a-7ca2-4292-a507-33bec38757bd tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:33.583597 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-af65ca5a-7ca2-4292-a507-33bec38757bd tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1225 microversion: 2.1 time: 0.378996 Feb 16 14:25:33.598585 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 13/45] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:33 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1225 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:33.611717 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-56b4fc41-c6ea-4df9-aec9-03fc05be4ee6 tempest-VolumesTestJSON-919716079 tempest-VolumesTestJSON-919716079-project] Calling method '.version_select at 0x7f2991b61550>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:33.751761 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-56b4fc41-c6ea-4df9-aec9-03fc05be4ee6 tempest-VolumesTestJSON-919716079 tempest-VolumesTestJSON-919716079-project] 10.222.0.110 "GET /compute/v2.1/os-volumes/2e6cc67f-a5dc-4fae-8231-d78e9899e264" status: 200 len: 350 microversion: 2.1 time: 0.150299 Feb 16 14:25:33.755344 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 14/46] 10.222.0.110 () {58 vars in 1249 bytes} [Wed Feb 16 14:25:33 2022] GET /compute/v2.1/os-volumes/2e6cc67f-a5dc-4fae-8231-d78e9899e264 => generated 350 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:25:33.769563 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-3c8c8cd7-3bf4-4117-9dd0-817aba176f40 tempest-VolumesTestJSON-919716079 tempest-VolumesTestJSON-919716079-project] Calling method '.version_select at 0x7f2991b30700>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:33.969380 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-3c8c8cd7-3bf4-4117-9dd0-817aba176f40 tempest-VolumesTestJSON-919716079 tempest-VolumesTestJSON-919716079-project] 10.222.0.110 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.204086 Feb 16 14:25:33.970567 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 15/47] 10.222.0.110 () {58 vars in 1138 bytes} [Wed Feb 16 14:25:33 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:25:33.978387 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-0433e89e-5278-415e-9680-bcee48146436 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-251890407", "imageRef": "2493d2dc-e081-43d3-8292-91b4762a21e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:25:34.090949 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.network.neutron [None req-0433e89e-5278-415e-9680-bcee48146436 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] validate_networks() for [('4ba8543b-8e56-4793-9ca0-86543e7d7d00', None, None, None, None, None)] {{(pid=117032) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 16 14:25:34.183733 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-9e2695ec-d467-4d77-a426-3e991d369828 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd701d137d5744a3ea6b17a8568da17c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d38e42748249e495e0d4f675a018a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:34.194957 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-9e2695ec-d467-4d77-a426-3e991d369828 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 200 len: 1319 microversion: 2.1 time: 1.030192 Feb 16 14:25:34.208058 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 33/48] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:33 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 1319 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:34.225266 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-77d1dc5e-2fe2-4e43-a079-451cded8f6e2 tempest-VolumesTestJSON-919716079 tempest-VolumesTestJSON-919716079-project] Calling method '.version_select at 0x7f2992b95550>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:34.641321 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-77d1dc5e-2fe2-4e43-a079-451cded8f6e2 tempest-VolumesTestJSON-919716079 tempest-VolumesTestJSON-919716079-project] 10.222.0.110 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.431649 Feb 16 14:25:34.646981 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 34/49] 10.222.0.110 () {58 vars in 1153 bytes} [Wed Feb 16 14:25:34 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:25:34.667365 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-13880a1c-47d3-446d-842f-e2da0ac5586e tempest-VolumesTestJSON-919716079 tempest-VolumesTestJSON-919716079-project] Calling method '.version_select at 0x7f2992bd9790>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:34.902662 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-13880a1c-47d3-446d-842f-e2da0ac5586e tempest-VolumesTestJSON-919716079 tempest-VolumesTestJSON-919716079-project] 10.222.0.110 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.242811 Feb 16 14:25:34.910084 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 35/50] 10.222.0.110 () {58 vars in 1138 bytes} [Wed Feb 16 14:25:34 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:34.915474 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-9fbd7041-8c4b-438d-b147-957ca0be7abd tempest-VolumesTestJSON-919716079 tempest-VolumesTestJSON-919716079-project] Calling method '.version_select at 0x7f2992b55550>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:35.180855 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-9fbd7041-8c4b-438d-b147-957ca0be7abd tempest-VolumesTestJSON-919716079 tempest-VolumesTestJSON-919716079-project] 10.222.0.110 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.269057 Feb 16 14:25:35.181800 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 36/51] 10.222.0.110 () {58 vars in 1171 bytes} [Wed Feb 16 14:25:34 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:25:35.209054 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-706ea73a-a43b-49d0-ad43-f88365f44876 tempest-VolumesTestJSON-919716079 tempest-VolumesTestJSON-919716079-project] Calling method '.version_select at 0x7f2992b55af0>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:35.459800 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-706ea73a-a43b-49d0-ad43-f88365f44876 tempest-VolumesTestJSON-919716079 tempest-VolumesTestJSON-919716079-project] 10.222.0.110 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.256171 Feb 16 14:25:35.460503 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 37/52] 10.222.0.110 () {58 vars in 1174 bytes} [Wed Feb 16 14:25:35 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:25:35.473426 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-3f863d07-6d9c-4b30-a8cb-e620a645b9c4 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:35.474364 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-3f863d07-6d9c-4b30-a8cb-e620a645b9c4 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:35.490367 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3f863d07-6d9c-4b30-a8cb-e620a645b9c4 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:35.502710 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3f863d07-6d9c-4b30-a8cb-e620a645b9c4 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:35.502710 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3f863d07-6d9c-4b30-a8cb-e620a645b9c4 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:35.502710 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3f863d07-6d9c-4b30-a8cb-e620a645b9c4 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:36.018420 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-0433e89e-5278-415e-9680-bcee48146436 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Flavor limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 16 14:25:36.025648 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-0433e89e-5278-415e-9680-bcee48146436 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Image limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 16 14:25:36.026391 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-0433e89e-5278-415e-9680-bcee48146436 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Flavor pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 16 14:25:36.028348 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-0433e89e-5278-415e-9680-bcee48146436 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Image pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 16 14:25:36.028892 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-0433e89e-5278-415e-9680-bcee48146436 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 16 14:25:36.078647 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0433e89e-5278-415e-9680-bcee48146436 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:36.091200 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0433e89e-5278-415e-9680-bcee48146436 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:36.098859 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0433e89e-5278-415e-9680-bcee48146436 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:36.099677 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0433e89e-5278-415e-9680-bcee48146436 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:36.163528 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-0433e89e-5278-415e-9680-bcee48146436 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Getting quotas for project bf4ddcdf7f0a469fa577164b86beb7cf. Resources: {'cores', 'instances', 'ram'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 14:25:36.175269 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-0433e89e-5278-415e-9680-bcee48146436 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Getting quotas for user d0b7c9898884449ca201f16f583baa21 and project bf4ddcdf7f0a469fa577164b86beb7cf. Resources: {'cores', 'instances', 'ram'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 14:25:36.220273 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-0433e89e-5278-415e-9680-bcee48146436 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Going to run 1 instances... {{(pid=117032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 16 14:25:36.223616 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-0433e89e-5278-415e-9680-bcee48146436 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2493d2dc-e081-43d3-8292-91b4762a21e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 16 14:25:36.379019 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-3f863d07-6d9c-4b30-a8cb-e620a645b9c4 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd701d137d5744a3ea6b17a8568da17c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d38e42748249e495e0d4f675a018a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:36.395177 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-3f863d07-6d9c-4b30-a8cb-e620a645b9c4 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 200 len: 1319 microversion: 2.1 time: 0.925458 Feb 16 14:25:36.404961 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 38/53] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:35 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 1319 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:36.407677 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-4aba7d45-0df7-4091-9880-be9f56f1856e tempest-VolumesTestJSON-919716079 tempest-VolumesTestJSON-919716079-project] Calling method '.version_select at 0x7f2992be4a60>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:36.501706 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-0433e89e-5278-415e-9680-bcee48146436 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 2.529605 Feb 16 14:25:36.503141 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 16/54] 10.222.0.110 () {60 vars in 1151 bytes} [Wed Feb 16 14:25:33 2022] POST /compute/v2.1/servers => generated 385 bytes in 2532 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Feb 16 14:25:36.510295 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c4b82d44-34f2-46d7-a964-c6f534eb1514 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1863633454", "imageRef": "2493d2dc-e081-43d3-8292-91b4762a21e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d94143be-8ba2-454c-8d39-3ad4b5796d55"}], "security_groups": [{"name": "tempest-securitygroup--953303239"}], "key_name": "tempest-keypair-74248194", "user_data": "}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:25:36.662036 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-4aba7d45-0df7-4091-9880-be9f56f1856e tempest-VolumesTestJSON-919716079 tempest-VolumesTestJSON-919716079-project] 10.222.0.110 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.264289 Feb 16 14:25:36.663146 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 39/55] 10.222.0.110 () {58 vars in 1159 bytes} [Wed Feb 16 14:25:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:36.668682 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-4f60d23b-0bde-45c8-8446-dfdac8119369 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:36.669431 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-4f60d23b-0bde-45c8-8446-dfdac8119369 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:36.985037 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-4f60d23b-0bde-45c8-8446-dfdac8119369 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:36.998840 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-4f60d23b-0bde-45c8-8446-dfdac8119369 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1225 microversion: 2.1 time: 0.334453 Feb 16 14:25:37.001360 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 40/56] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:36 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1225 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:37.016081 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-904980ad-f216-4af4-9906-d1fe7b8a4246 tempest-VolumesTestJSON-919716079 tempest-VolumesTestJSON-919716079-project] Calling method '.version_select at 0x7f2992b955e0>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:37.327866 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.network.neutron [None req-c4b82d44-34f2-46d7-a964-c6f534eb1514 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] validate_networks() for [('d94143be-8ba2-454c-8d39-3ad4b5796d55', None, None, None, None, None)] {{(pid=117032) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 16 14:25:37.339262 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-904980ad-f216-4af4-9906-d1fe7b8a4246 tempest-VolumesTestJSON-919716079 tempest-VolumesTestJSON-919716079-project] 10.222.0.110 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.336678 Feb 16 14:25:37.340244 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 41/57] 10.222.0.110 () {58 vars in 1192 bytes} [Wed Feb 16 14:25:37 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:25:37.356948 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-923eb389-f314-4305-9bab-ab38fd5272f4 tempest-VolumesTestJSON-919716079 tempest-VolumesTestJSON-919716079-project] Calling method '.version_select at 0x7f29936193a0>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:37.571280 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-923eb389-f314-4305-9bab-ab38fd5272f4 tempest-VolumesTestJSON-919716079 tempest-VolumesTestJSON-919716079-project] 10.222.0.110 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.221957 Feb 16 14:25:37.572682 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 42/58] 10.222.0.110 () {58 vars in 1159 bytes} [Wed Feb 16 14:25:37 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:25:37.581740 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-0557100c-6b7f-4f7e-8cb5-0b6cb004b15b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1982848726", "imageRef": "2493d2dc-e081-43d3-8292-91b4762a21e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b44c56ce-4ab9-4b55-a9f4-2cfe356cbeb8"}], "security_groups": [{"name": "tempest-securitygroup--1781587255"}], "key_name": "tempest-keypair-50919512", "user_data": "}} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:25:37.986471 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.network.neutron [None req-0557100c-6b7f-4f7e-8cb5-0b6cb004b15b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] validate_networks() for [('b44c56ce-4ab9-4b55-a9f4-2cfe356cbeb8', None, None, None, None, None)] {{(pid=117031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 16 14:25:40.060780 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-c4b82d44-34f2-46d7-a964-c6f534eb1514 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Flavor limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 16 14:25:40.066335 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-c4b82d44-34f2-46d7-a964-c6f534eb1514 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Image limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 16 14:25:40.067057 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-c4b82d44-34f2-46d7-a964-c6f534eb1514 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Flavor pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 16 14:25:40.068901 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-c4b82d44-34f2-46d7-a964-c6f534eb1514 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Image pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 16 14:25:40.070259 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-c4b82d44-34f2-46d7-a964-c6f534eb1514 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 16 14:25:40.108075 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c4b82d44-34f2-46d7-a964-c6f534eb1514 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:40.109024 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c4b82d44-34f2-46d7-a964-c6f534eb1514 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:40.111182 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c4b82d44-34f2-46d7-a964-c6f534eb1514 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:40.112208 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c4b82d44-34f2-46d7-a964-c6f534eb1514 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:40.163656 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-c4b82d44-34f2-46d7-a964-c6f534eb1514 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Getting quotas for project d48b56501b0a49829c4522b171dd1159. Resources: {'cores', 'instances', 'ram'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 14:25:40.176386 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-c4b82d44-34f2-46d7-a964-c6f534eb1514 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Getting quotas for user bdbb57cd56c5450aacce437150585ea0 and project d48b56501b0a49829c4522b171dd1159. Resources: {'cores', 'instances', 'ram'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 14:25:40.245512 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c4b82d44-34f2-46d7-a964-c6f534eb1514 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Going to run 1 instances... {{(pid=117032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 16 14:25:40.248291 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c4b82d44-34f2-46d7-a964-c6f534eb1514 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2493d2dc-e081-43d3-8292-91b4762a21e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 16 14:25:40.340886 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-0557100c-6b7f-4f7e-8cb5-0b6cb004b15b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Flavor limits 0:0:0 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 16 14:25:40.341374 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-0557100c-6b7f-4f7e-8cb5-0b6cb004b15b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Image limits 0:0:0 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 16 14:25:40.341796 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-0557100c-6b7f-4f7e-8cb5-0b6cb004b15b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Flavor pref 0:0:0 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 16 14:25:40.342222 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-0557100c-6b7f-4f7e-8cb5-0b6cb004b15b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Image pref 0:0:0 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 16 14:25:40.342912 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-0557100c-6b7f-4f7e-8cb5-0b6cb004b15b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 16 14:25:40.377000 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0557100c-6b7f-4f7e-8cb5-0b6cb004b15b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:40.380221 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0557100c-6b7f-4f7e-8cb5-0b6cb004b15b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:40.383115 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0557100c-6b7f-4f7e-8cb5-0b6cb004b15b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:40.384182 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0557100c-6b7f-4f7e-8cb5-0b6cb004b15b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:40.471254 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c4b82d44-34f2-46d7-a964-c6f534eb1514 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 3.966100 Feb 16 14:25:40.477733 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 17/59] 10.222.0.110 () {60 vars in 1151 bytes} [Wed Feb 16 14:25:36 2022] POST /compute/v2.1/servers => generated 403 bytes in 3974 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Feb 16 14:25:40.482773 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c75a8ccf-dbd7-40f8-bf40-5ef523d0c919 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:40.487502 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.quota [None req-0557100c-6b7f-4f7e-8cb5-0b6cb004b15b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Getting quotas for project aeb2105b246e4f78bccf81a39b007f69. Resources: {'cores', 'instances', 'ram'} {{(pid=117031) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 14:25:40.511069 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c75a8ccf-dbd7-40f8-bf40-5ef523d0c919 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:40.526060 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c75a8ccf-dbd7-40f8-bf40-5ef523d0c919 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:40.526060 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c75a8ccf-dbd7-40f8-bf40-5ef523d0c919 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:40.526060 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c75a8ccf-dbd7-40f8-bf40-5ef523d0c919 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:40.526060 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c75a8ccf-dbd7-40f8-bf40-5ef523d0c919 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:40.527101 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.quota [None req-0557100c-6b7f-4f7e-8cb5-0b6cb004b15b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Getting quotas for user 745ca4a19a674037b9fee7f3778c05eb and project aeb2105b246e4f78bccf81a39b007f69. Resources: {'cores', 'instances', 'ram'} {{(pid=117031) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 14:25:40.556462 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-0557100c-6b7f-4f7e-8cb5-0b6cb004b15b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Going to run 1 instances... {{(pid=117031) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 16 14:25:40.559710 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-0557100c-6b7f-4f7e-8cb5-0b6cb004b15b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2493d2dc-e081-43d3-8292-91b4762a21e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 16 14:25:40.845286 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-0557100c-6b7f-4f7e-8cb5-0b6cb004b15b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.20 time: 3.269906 Feb 16 14:25:40.851794 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 43/60] 10.222.0.110 () {62 vars in 1192 bytes} [Wed Feb 16 14:25:37 2022] POST /compute/v2.1/servers => generated 404 bytes in 3278 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Feb 16 14:25:40.863475 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-d16dd830-d1ba-437f-8676-55b5ac9eed12 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:40.872871 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-d16dd830-d1ba-437f-8676-55b5ac9eed12 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:40.895481 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d16dd830-d1ba-437f-8676-55b5ac9eed12 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:40.897486 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d16dd830-d1ba-437f-8676-55b5ac9eed12 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:40.932118 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d16dd830-d1ba-437f-8676-55b5ac9eed12 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:40.932118 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d16dd830-d1ba-437f-8676-55b5ac9eed12 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:41.147547 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-d16dd830-d1ba-437f-8676-55b5ac9eed12 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:41.159193 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-d16dd830-d1ba-437f-8676-55b5ac9eed12 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1283 microversion: 2.1 time: 0.305450 Feb 16 14:25:41.171605 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 44/61] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:40 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1283 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:41.502900 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-eb56ba96-8143-4180-881f-7c533714b69d req-cbbc941c-81f6-466d-914f-e24d9d203898 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5", "tag": "c1966fb6-188c-4fce-ae9a-a15dd7b2bc08"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:25:41.509648 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:25:41.509648 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:25:41.526048 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-eb56ba96-8143-4180-881f-7c533714b69d req-cbbc941c-81f6-466d-914f-e24d9d203898 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:41.531591 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-eb56ba96-8143-4180-881f-7c533714b69d req-cbbc941c-81f6-466d-914f-e24d9d203898 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:41.553383 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-eb56ba96-8143-4180-881f-7c533714b69d req-cbbc941c-81f6-466d-914f-e24d9d203898 service nova] Creating event network-changed:c1966fb6-188c-4fce-ae9a-a15dd7b2bc08 for instance 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 on hv-cinder-80473 Feb 16 14:25:41.554413 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-eb56ba96-8143-4180-881f-7c533714b69d req-cbbc941c-81f6-466d-914f-e24d9d203898 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117031) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 16 14:25:41.556820 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0cfb4757-9e47-473b-8ffa-09cf51b798ab None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:41.557279 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0cfb4757-9e47-473b-8ffa-09cf51b798ab None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:41.558322 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0cfb4757-9e47-473b-8ffa-09cf51b798ab None None] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:41.559423 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0cfb4757-9e47-473b-8ffa-09cf51b798ab None None] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:41.575665 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.compute.rpcapi [None req-0cfb4757-9e47-473b-8ffa-09cf51b798ab None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Feb 16 14:25:41.577116 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0cfb4757-9e47-473b-8ffa-09cf51b798ab None None] Releasing lock "compute-rpcapi-router" {{(pid=117031) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 16 14:25:41.618969 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-0cfb4757-9e47-473b-8ffa-09cf51b798ab None None] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.445705 Feb 16 14:25:41.619876 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 45/62] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:25:41.631378 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-13731924-4cc4-4183-9d26-41bf18870a20 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:41.631378 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-13731924-4cc4-4183-9d26-41bf18870a20 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:41.808103 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-13731924-4cc4-4183-9d26-41bf18870a20 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:41.818617 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-13731924-4cc4-4183-9d26-41bf18870a20 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1240 microversion: 2.1 time: 0.197399 Feb 16 14:25:41.823998 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 46/63] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:41 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1240 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:41.836965 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-3b655748-d66f-4467-9176-fce60a926e89 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:41.836965 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-3b655748-d66f-4467-9176-fce60a926e89 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:41.971997 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-3b655748-d66f-4467-9176-fce60a926e89 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:41.989411 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-3b655748-d66f-4467-9176-fce60a926e89 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:41.991387 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-3b655748-d66f-4467-9176-fce60a926e89 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:41.997102 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-3b655748-d66f-4467-9176-fce60a926e89 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1284 microversion: 2.20 time: 0.167285 Feb 16 14:25:42.004610 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 47/64] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:25:41 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1284 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:25:42.026000 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c75a8ccf-dbd7-40f8-bf40-5ef523d0c919 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd701d137d5744a3ea6b17a8568da17c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d38e42748249e495e0d4f675a018a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:42.084728 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c75a8ccf-dbd7-40f8-bf40-5ef523d0c919 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 200 len: 1319 microversion: 2.1 time: 1.605527 Feb 16 14:25:42.086818 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 18/65] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:40 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 1319 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:42.188585 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-6763ba82-6f0a-440b-b008-cad4d2499137 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:42.189796 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-6763ba82-6f0a-440b-b008-cad4d2499137 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:42.202194 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-6763ba82-6f0a-440b-b008-cad4d2499137 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:42.207833 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-6763ba82-6f0a-440b-b008-cad4d2499137 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:42.208783 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-6763ba82-6f0a-440b-b008-cad4d2499137 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:42.214950 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-6763ba82-6f0a-440b-b008-cad4d2499137 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:42.446055 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-6763ba82-6f0a-440b-b008-cad4d2499137 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:42.466393 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-6763ba82-6f0a-440b-b008-cad4d2499137 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1283 microversion: 2.1 time: 0.287766 Feb 16 14:25:42.467340 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 48/66] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:42 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1283 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:25:42.992536 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-00c072d7-3ae8-465b-88d4-3eedaf77b677 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:42.992536 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-00c072d7-3ae8-465b-88d4-3eedaf77b677 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:42.992536 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-00c072d7-3ae8-465b-88d4-3eedaf77b677 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:42.992536 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-00c072d7-3ae8-465b-88d4-3eedaf77b677 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:42.993320 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-00c072d7-3ae8-465b-88d4-3eedaf77b677 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:42.993320 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-00c072d7-3ae8-465b-88d4-3eedaf77b677 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:42.993320 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-00c072d7-3ae8-465b-88d4-3eedaf77b677 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:42.993995 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-00c072d7-3ae8-465b-88d4-3eedaf77b677 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1236 microversion: 2.1 time: 0.147391 Feb 16 14:25:42.993995 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 19/67] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:42 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1236 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:43.013065 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-16033b86-7740-42f0-977d-ac4072f42ae9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:43.013681 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-16033b86-7740-42f0-977d-ac4072f42ae9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:43.032017 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-16033b86-7740-42f0-977d-ac4072f42ae9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:43.032531 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-16033b86-7740-42f0-977d-ac4072f42ae9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:43.033279 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-16033b86-7740-42f0-977d-ac4072f42ae9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:43.033724 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-16033b86-7740-42f0-977d-ac4072f42ae9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:43.100876 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-16033b86-7740-42f0-977d-ac4072f42ae9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:43.103777 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-8505b96b-bb11-437a-880b-26f6e624e933 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:43.104960 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-8505b96b-bb11-437a-880b-26f6e624e933 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:43.110801 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-16033b86-7740-42f0-977d-ac4072f42ae9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:43.110969 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8505b96b-bb11-437a-880b-26f6e624e933 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:43.111362 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8505b96b-bb11-437a-880b-26f6e624e933 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:43.112153 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8505b96b-bb11-437a-880b-26f6e624e933 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:43.112593 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8505b96b-bb11-437a-880b-26f6e624e933 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:43.112970 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-16033b86-7740-42f0-977d-ac4072f42ae9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:43.114360 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-16033b86-7740-42f0-977d-ac4072f42ae9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1288 microversion: 2.20 time: 0.105386 Feb 16 14:25:43.114995 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 49/68] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:25:43 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1288 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:25:43.258805 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-8505b96b-bb11-437a-880b-26f6e624e933 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd701d137d5744a3ea6b17a8568da17c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d38e42748249e495e0d4f675a018a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:43.266713 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-8505b96b-bb11-437a-880b-26f6e624e933 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 200 len: 1319 microversion: 2.1 time: 0.167211 Feb 16 14:25:43.267397 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 20/69] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:43 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:25:43.483858 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-61d010d9-43ac-47b5-a9d7-06c50c555cba tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:43.484484 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-61d010d9-43ac-47b5-a9d7-06c50c555cba tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:43.490613 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-61d010d9-43ac-47b5-a9d7-06c50c555cba tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:43.491094 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-61d010d9-43ac-47b5-a9d7-06c50c555cba tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:43.491919 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-61d010d9-43ac-47b5-a9d7-06c50c555cba tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:43.492815 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-61d010d9-43ac-47b5-a9d7-06c50c555cba tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:43.556301 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-61d010d9-43ac-47b5-a9d7-06c50c555cba tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:43.563850 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-61d010d9-43ac-47b5-a9d7-06c50c555cba tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1283 microversion: 2.1 time: 0.083787 Feb 16 14:25:43.564413 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 50/70] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:43 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1283 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:44.000868 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-7cb5c1dc-b4b5-4721-812b-eceae3bdcc1d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:44.001599 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-7cb5c1dc-b4b5-4721-812b-eceae3bdcc1d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:44.009625 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7cb5c1dc-b4b5-4721-812b-eceae3bdcc1d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:44.010188 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7cb5c1dc-b4b5-4721-812b-eceae3bdcc1d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:44.011216 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7cb5c1dc-b4b5-4721-812b-eceae3bdcc1d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:44.011800 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7cb5c1dc-b4b5-4721-812b-eceae3bdcc1d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:44.090820 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-7cb5c1dc-b4b5-4721-812b-eceae3bdcc1d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:44.098949 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-7cb5c1dc-b4b5-4721-812b-eceae3bdcc1d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1236 microversion: 2.1 time: 0.103203 Feb 16 14:25:44.100174 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 21/71] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:43 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1236 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:44.137881 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-36c8a100-0e41-46cf-a818-a15eb2c831d3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:44.140058 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-36c8a100-0e41-46cf-a818-a15eb2c831d3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:44.145754 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-36c8a100-0e41-46cf-a818-a15eb2c831d3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:44.146876 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-36c8a100-0e41-46cf-a818-a15eb2c831d3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:44.147642 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-36c8a100-0e41-46cf-a818-a15eb2c831d3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:44.148075 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-36c8a100-0e41-46cf-a818-a15eb2c831d3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:44.209697 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-36c8a100-0e41-46cf-a818-a15eb2c831d3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:44.218221 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-36c8a100-0e41-46cf-a818-a15eb2c831d3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:44.219782 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-36c8a100-0e41-46cf-a818-a15eb2c831d3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:44.220987 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-36c8a100-0e41-46cf-a818-a15eb2c831d3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1288 microversion: 2.20 time: 0.087023 Feb 16 14:25:44.221551 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 51/72] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:25:44 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1288 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:25:44.284355 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-555da4a3-a4af-422e-8aa5-6d1d1227c662 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:44.286157 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-555da4a3-a4af-422e-8aa5-6d1d1227c662 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:44.293449 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-555da4a3-a4af-422e-8aa5-6d1d1227c662 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:44.293906 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-555da4a3-a4af-422e-8aa5-6d1d1227c662 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:44.294738 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-555da4a3-a4af-422e-8aa5-6d1d1227c662 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:44.295183 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-555da4a3-a4af-422e-8aa5-6d1d1227c662 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:44.546783 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-555da4a3-a4af-422e-8aa5-6d1d1227c662 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd701d137d5744a3ea6b17a8568da17c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d38e42748249e495e0d4f675a018a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:44.554971 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-555da4a3-a4af-422e-8aa5-6d1d1227c662 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 200 len: 1319 microversion: 2.1 time: 0.273715 Feb 16 14:25:44.559031 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 22/73] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:44 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 1319 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:44.583518 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-efb02721-bbbb-4797-bbcd-d55e6ce3ee31 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:44.584333 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-efb02721-bbbb-4797-bbcd-d55e6ce3ee31 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:44.593711 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-efb02721-bbbb-4797-bbcd-d55e6ce3ee31 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:44.594165 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-efb02721-bbbb-4797-bbcd-d55e6ce3ee31 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:44.594981 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-efb02721-bbbb-4797-bbcd-d55e6ce3ee31 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:44.595591 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-efb02721-bbbb-4797-bbcd-d55e6ce3ee31 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:44.781506 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-efb02721-bbbb-4797-bbcd-d55e6ce3ee31 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:44.789571 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-efb02721-bbbb-4797-bbcd-d55e6ce3ee31 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1325 microversion: 2.1 time: 0.210410 Feb 16 14:25:44.790668 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 52/74] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:44 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1325 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:44.803825 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-6bae320b-1ced-4ca0-a7d1-0327bedd7acb req-8ef54f65-a223-4bf2-8421-7f58d883437d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05accb7b-6275-4c8e-a18b-69b67bdc1d8d", "tag": "9be133d6-37da-4b5d-bf19-f8153906954d"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:25:44.808047 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:25:44.808047 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: warnings.warn(msg) Feb 16 14:25:44.822542 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-6bae320b-1ced-4ca0-a7d1-0327bedd7acb req-8ef54f65-a223-4bf2-8421-7f58d883437d service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:44.822954 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-6bae320b-1ced-4ca0-a7d1-0327bedd7acb req-8ef54f65-a223-4bf2-8421-7f58d883437d service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:44.860370 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-6bae320b-1ced-4ca0-a7d1-0327bedd7acb req-8ef54f65-a223-4bf2-8421-7f58d883437d service nova] Creating event network-changed:9be133d6-37da-4b5d-bf19-f8153906954d for instance 05accb7b-6275-4c8e-a18b-69b67bdc1d8d on hv-cinder-80473 Feb 16 14:25:44.861280 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-6bae320b-1ced-4ca0-a7d1-0327bedd7acb req-8ef54f65-a223-4bf2-8421-7f58d883437d service nova] Acquired lock "compute-rpcapi-router" {{(pid=117032) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 16 14:25:44.862884 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ca0f8faa-ccd5-443a-9549-65d2aa3194b8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:44.863488 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ca0f8faa-ccd5-443a-9549-65d2aa3194b8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:44.864932 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ca0f8faa-ccd5-443a-9549-65d2aa3194b8 None None] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:44.865528 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ca0f8faa-ccd5-443a-9549-65d2aa3194b8 None None] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:44.878069 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.compute.rpcapi [None req-ca0f8faa-ccd5-443a-9549-65d2aa3194b8 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Feb 16 14:25:44.878941 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ca0f8faa-ccd5-443a-9549-65d2aa3194b8 None None] Releasing lock "compute-rpcapi-router" {{(pid=117032) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 16 14:25:44.902557 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ca0f8faa-ccd5-443a-9549-65d2aa3194b8 None None] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103183 Feb 16 14:25:44.903215 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 23/75] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:25:45.116209 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-97295ccf-b7d5-437b-b100-82489570511b tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:45.116826 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-97295ccf-b7d5-437b-b100-82489570511b tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:45.128695 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-97295ccf-b7d5-437b-b100-82489570511b tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:45.129243 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-97295ccf-b7d5-437b-b100-82489570511b tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:45.130050 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-97295ccf-b7d5-437b-b100-82489570511b tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:45.130484 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-97295ccf-b7d5-437b-b100-82489570511b tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:45.199369 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-97295ccf-b7d5-437b-b100-82489570511b tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:45.206858 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-97295ccf-b7d5-437b-b100-82489570511b tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1236 microversion: 2.1 time: 0.094569 Feb 16 14:25:45.207430 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 53/76] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:45 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1236 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:45.239609 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-fa16bc70-06d2-417f-a57d-33d627ff86da tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:45.240316 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-fa16bc70-06d2-417f-a57d-33d627ff86da tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:45.247884 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fa16bc70-06d2-417f-a57d-33d627ff86da tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:45.248333 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fa16bc70-06d2-417f-a57d-33d627ff86da tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:45.249123 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fa16bc70-06d2-417f-a57d-33d627ff86da tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:45.249560 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fa16bc70-06d2-417f-a57d-33d627ff86da tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:45.319643 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-fa16bc70-06d2-417f-a57d-33d627ff86da tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:45.329124 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-fa16bc70-06d2-417f-a57d-33d627ff86da tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:45.330671 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-fa16bc70-06d2-417f-a57d-33d627ff86da tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:45.333502 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-fa16bc70-06d2-417f-a57d-33d627ff86da tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1288 microversion: 2.20 time: 0.098007 Feb 16 14:25:45.334096 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 24/77] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:25:45 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1288 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:25:45.572307 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-375b4a1e-34ce-428d-a019-6debf344db72 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:45.573171 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-375b4a1e-34ce-428d-a019-6debf344db72 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:45.584014 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-375b4a1e-34ce-428d-a019-6debf344db72 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:45.584472 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-375b4a1e-34ce-428d-a019-6debf344db72 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:45.585328 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-375b4a1e-34ce-428d-a019-6debf344db72 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:45.587769 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-375b4a1e-34ce-428d-a019-6debf344db72 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:45.796347 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-375b4a1e-34ce-428d-a019-6debf344db72 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd701d137d5744a3ea6b17a8568da17c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d38e42748249e495e0d4f675a018a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:45.806106 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-375b4a1e-34ce-428d-a019-6debf344db72 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 200 len: 1319 microversion: 2.1 time: 0.238007 Feb 16 14:25:45.806491 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f614fb42-a4fe-4f11-a7d5-f22a73bf288d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:45.807316 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f614fb42-a4fe-4f11-a7d5-f22a73bf288d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:45.814654 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 54/78] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:45 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:45.825400 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f614fb42-a4fe-4f11-a7d5-f22a73bf288d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:45.829146 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f614fb42-a4fe-4f11-a7d5-f22a73bf288d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:45.830176 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f614fb42-a4fe-4f11-a7d5-f22a73bf288d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:45.830817 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f614fb42-a4fe-4f11-a7d5-f22a73bf288d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:46.034110 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f614fb42-a4fe-4f11-a7d5-f22a73bf288d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:46.064207 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f614fb42-a4fe-4f11-a7d5-f22a73bf288d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1325 microversion: 2.1 time: 0.261508 Feb 16 14:25:46.065145 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 25/79] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:45 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1325 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:25:46.222873 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-12c4e7bc-58a3-4d95-b5ad-de760377bf8f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:46.232019 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-12c4e7bc-58a3-4d95-b5ad-de760377bf8f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:46.232752 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-12c4e7bc-58a3-4d95-b5ad-de760377bf8f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:46.233379 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-12c4e7bc-58a3-4d95-b5ad-de760377bf8f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:46.234172 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-12c4e7bc-58a3-4d95-b5ad-de760377bf8f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:46.243742 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-12c4e7bc-58a3-4d95-b5ad-de760377bf8f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:46.358305 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a9da7a4e-63ca-4fc1-9943-bbbf3be856cf tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:46.358305 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a9da7a4e-63ca-4fc1-9943-bbbf3be856cf tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:46.380396 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-12c4e7bc-58a3-4d95-b5ad-de760377bf8f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:46.390537 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a9da7a4e-63ca-4fc1-9943-bbbf3be856cf tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:46.391668 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-12c4e7bc-58a3-4d95-b5ad-de760377bf8f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1236 microversion: 2.1 time: 0.172649 Feb 16 14:25:46.392368 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a9da7a4e-63ca-4fc1-9943-bbbf3be856cf tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:46.393604 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a9da7a4e-63ca-4fc1-9943-bbbf3be856cf tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:46.405027 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a9da7a4e-63ca-4fc1-9943-bbbf3be856cf tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:46.407947 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 55/80] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:46 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1236 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:46.496093 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a9da7a4e-63ca-4fc1-9943-bbbf3be856cf tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:46.505220 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a9da7a4e-63ca-4fc1-9943-bbbf3be856cf tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:46.506953 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a9da7a4e-63ca-4fc1-9943-bbbf3be856cf tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:46.508604 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a9da7a4e-63ca-4fc1-9943-bbbf3be856cf tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1288 microversion: 2.20 time: 0.159178 Feb 16 14:25:46.519673 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 26/81] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:25:46 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1288 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:25:46.824346 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-edaeb78c-d7da-403b-bfa6-4c3c8c1def9e tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:46.825231 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-edaeb78c-d7da-403b-bfa6-4c3c8c1def9e tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:46.833039 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-edaeb78c-d7da-403b-bfa6-4c3c8c1def9e tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:46.837500 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-edaeb78c-d7da-403b-bfa6-4c3c8c1def9e tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:46.838330 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-edaeb78c-d7da-403b-bfa6-4c3c8c1def9e tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:46.838830 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-edaeb78c-d7da-403b-bfa6-4c3c8c1def9e tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:47.004304 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-edaeb78c-d7da-403b-bfa6-4c3c8c1def9e tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd701d137d5744a3ea6b17a8568da17c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d38e42748249e495e0d4f675a018a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:47.012112 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-edaeb78c-d7da-403b-bfa6-4c3c8c1def9e tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 200 len: 1319 microversion: 2.1 time: 0.192407 Feb 16 14:25:47.012696 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 56/82] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:46 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:47.082844 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-aee3fe9c-d179-4ce9-bdb5-bd23b71e4b13 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:47.083867 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-aee3fe9c-d179-4ce9-bdb5-bd23b71e4b13 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:47.104697 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-aee3fe9c-d179-4ce9-bdb5-bd23b71e4b13 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:47.104697 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-aee3fe9c-d179-4ce9-bdb5-bd23b71e4b13 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:47.104697 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-aee3fe9c-d179-4ce9-bdb5-bd23b71e4b13 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:47.104697 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-aee3fe9c-d179-4ce9-bdb5-bd23b71e4b13 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:47.273448 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-aee3fe9c-d179-4ce9-bdb5-bd23b71e4b13 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:47.280894 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-aee3fe9c-d179-4ce9-bdb5-bd23b71e4b13 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1325 microversion: 2.1 time: 0.203438 Feb 16 14:25:47.281451 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 27/83] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:47 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1325 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:47.415134 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-41c813b5-a7e4-46f9-9dc4-6d89a1b70e3b tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:47.416176 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-41c813b5-a7e4-46f9-9dc4-6d89a1b70e3b tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:47.444461 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-41c813b5-a7e4-46f9-9dc4-6d89a1b70e3b tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:47.446568 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-41c813b5-a7e4-46f9-9dc4-6d89a1b70e3b tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:47.448233 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-41c813b5-a7e4-46f9-9dc4-6d89a1b70e3b tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:47.449555 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-41c813b5-a7e4-46f9-9dc4-6d89a1b70e3b tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:47.527816 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-53619fd7-49c2-4518-9b94-37dfa7f8c517 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:47.529272 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-53619fd7-49c2-4518-9b94-37dfa7f8c517 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:47.544665 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-53619fd7-49c2-4518-9b94-37dfa7f8c517 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:47.544874 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-41c813b5-a7e4-46f9-9dc4-6d89a1b70e3b tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:47.545138 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-53619fd7-49c2-4518-9b94-37dfa7f8c517 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:47.545967 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-53619fd7-49c2-4518-9b94-37dfa7f8c517 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:47.546420 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-53619fd7-49c2-4518-9b94-37dfa7f8c517 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:47.580349 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-41c813b5-a7e4-46f9-9dc4-6d89a1b70e3b tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1236 microversion: 2.1 time: 0.172446 Feb 16 14:25:47.584308 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 57/84] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:47 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1236 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:47.685048 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-53619fd7-49c2-4518-9b94-37dfa7f8c517 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:47.703878 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-53619fd7-49c2-4518-9b94-37dfa7f8c517 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:47.705368 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-53619fd7-49c2-4518-9b94-37dfa7f8c517 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:47.706972 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-53619fd7-49c2-4518-9b94-37dfa7f8c517 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1288 microversion: 2.20 time: 0.183885 Feb 16 14:25:47.714843 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 28/85] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:25:47 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1288 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:25:48.039113 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-5456f708-aa5a-4b23-b738-02cda4284ffc tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:48.039993 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-5456f708-aa5a-4b23-b738-02cda4284ffc tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:48.055092 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5456f708-aa5a-4b23-b738-02cda4284ffc tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:48.055956 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5456f708-aa5a-4b23-b738-02cda4284ffc tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:48.057707 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5456f708-aa5a-4b23-b738-02cda4284ffc tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:48.057707 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5456f708-aa5a-4b23-b738-02cda4284ffc tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:48.229413 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-5456f708-aa5a-4b23-b738-02cda4284ffc tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd701d137d5744a3ea6b17a8568da17c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d38e42748249e495e0d4f675a018a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:48.237112 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-5456f708-aa5a-4b23-b738-02cda4284ffc tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 200 len: 1319 microversion: 2.1 time: 0.208311 Feb 16 14:25:48.237680 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 58/86] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:48 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:48.304118 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-4c780153-6c67-44ca-be7a-cccc12c82dbd tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:48.305255 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-4c780153-6c67-44ca-be7a-cccc12c82dbd tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:48.312918 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4c780153-6c67-44ca-be7a-cccc12c82dbd tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:48.313436 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4c780153-6c67-44ca-be7a-cccc12c82dbd tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:48.314465 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4c780153-6c67-44ca-be7a-cccc12c82dbd tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:48.314929 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4c780153-6c67-44ca-be7a-cccc12c82dbd tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:48.600823 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-7271613c-b2cf-4091-b8c9-74d18ffa5c48 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:48.601554 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-7271613c-b2cf-4091-b8c9-74d18ffa5c48 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:48.607841 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7271613c-b2cf-4091-b8c9-74d18ffa5c48 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:48.608370 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7271613c-b2cf-4091-b8c9-74d18ffa5c48 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:48.609254 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7271613c-b2cf-4091-b8c9-74d18ffa5c48 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:48.609741 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7271613c-b2cf-4091-b8c9-74d18ffa5c48 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:48.702191 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-7271613c-b2cf-4091-b8c9-74d18ffa5c48 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:48.710515 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-7271613c-b2cf-4091-b8c9-74d18ffa5c48 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1300 microversion: 2.1 time: 0.113539 Feb 16 14:25:48.714937 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 59/87] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:48 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1300 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:25:48.747859 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-3fb2fd8c-6cbe-4f09-935c-014adc6e42f9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:48.751166 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-3fb2fd8c-6cbe-4f09-935c-014adc6e42f9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:48.762303 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3fb2fd8c-6cbe-4f09-935c-014adc6e42f9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:48.762784 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3fb2fd8c-6cbe-4f09-935c-014adc6e42f9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:48.763740 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3fb2fd8c-6cbe-4f09-935c-014adc6e42f9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:48.764329 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3fb2fd8c-6cbe-4f09-935c-014adc6e42f9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:48.821395 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-4c780153-6c67-44ca-be7a-cccc12c82dbd tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:48.831839 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-4c780153-6c67-44ca-be7a-cccc12c82dbd tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1325 microversion: 2.1 time: 0.530931 Feb 16 14:25:48.843591 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 29/88] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:48 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1325 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:48.876154 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-3fb2fd8c-6cbe-4f09-935c-014adc6e42f9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:48.890753 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-3fb2fd8c-6cbe-4f09-935c-014adc6e42f9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:48.892656 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-3fb2fd8c-6cbe-4f09-935c-014adc6e42f9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:48.893991 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-3fb2fd8c-6cbe-4f09-935c-014adc6e42f9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1336 microversion: 2.20 time: 0.159355 Feb 16 14:25:48.895204 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 60/89] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:25:48 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1336 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:25:49.255066 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e70578c5-bbe3-439d-9ba8-01d5593940f8 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:49.255906 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-e70578c5-bbe3-439d-9ba8-01d5593940f8 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:49.264774 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e70578c5-bbe3-439d-9ba8-01d5593940f8 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:49.266476 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e70578c5-bbe3-439d-9ba8-01d5593940f8 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:49.267319 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e70578c5-bbe3-439d-9ba8-01d5593940f8 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:49.269582 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e70578c5-bbe3-439d-9ba8-01d5593940f8 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:49.501664 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-fc919552-b4db-455d-927f-d9a83fbbdb33 req-619ce379-f0cb-4b22-8cb8-ee1f5d041b19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dcd0641-a2af-472e-afdb-1b7c1c72666f", "tag": "47ff8a4b-9375-4563-92b3-af528e61b72f"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:25:49.503420 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:25:49.503420 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:25:49.525984 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-fc919552-b4db-455d-927f-d9a83fbbdb33 req-619ce379-f0cb-4b22-8cb8-ee1f5d041b19 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:49.527161 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-fc919552-b4db-455d-927f-d9a83fbbdb33 req-619ce379-f0cb-4b22-8cb8-ee1f5d041b19 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:49.553324 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-fc919552-b4db-455d-927f-d9a83fbbdb33 req-619ce379-f0cb-4b22-8cb8-ee1f5d041b19 service nova] Creating event network-changed:47ff8a4b-9375-4563-92b3-af528e61b72f for instance 3dcd0641-a2af-472e-afdb-1b7c1c72666f on hv-cinder-80473 Feb 16 14:25:49.559780 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-fc919552-b4db-455d-927f-d9a83fbbdb33 req-619ce379-f0cb-4b22-8cb8-ee1f5d041b19 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069072 Feb 16 14:25:49.561882 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 61/90] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:25:49.732393 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-7b3cb80d-34ac-4930-9b8f-b5feb918ce75 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:49.733098 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-7b3cb80d-34ac-4930-9b8f-b5feb918ce75 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:49.741109 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7b3cb80d-34ac-4930-9b8f-b5feb918ce75 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:49.741736 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7b3cb80d-34ac-4930-9b8f-b5feb918ce75 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:49.745697 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7b3cb80d-34ac-4930-9b8f-b5feb918ce75 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:49.746415 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7b3cb80d-34ac-4930-9b8f-b5feb918ce75 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:49.814985 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-7b3cb80d-34ac-4930-9b8f-b5feb918ce75 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:49.823911 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-7b3cb80d-34ac-4930-9b8f-b5feb918ce75 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1298 microversion: 2.1 time: 0.095389 Feb 16 14:25:49.824505 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 62/91] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:49 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1298 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:49.852515 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-26a5f478-b0bd-4c14-9a4e-cac7a826409f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:49.853471 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-26a5f478-b0bd-4c14-9a4e-cac7a826409f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:49.860790 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-26a5f478-b0bd-4c14-9a4e-cac7a826409f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:49.861539 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-26a5f478-b0bd-4c14-9a4e-cac7a826409f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:49.862929 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-26a5f478-b0bd-4c14-9a4e-cac7a826409f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:49.863731 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-26a5f478-b0bd-4c14-9a4e-cac7a826409f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:50.089542 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-e70578c5-bbe3-439d-9ba8-01d5593940f8 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd701d137d5744a3ea6b17a8568da17c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d38e42748249e495e0d4f675a018a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:50.097972 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-e70578c5-bbe3-439d-9ba8-01d5593940f8 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 200 len: 1319 microversion: 2.1 time: 0.847495 Feb 16 14:25:50.104567 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 30/92] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:49 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 1319 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:50.116776 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-915cff38-d263-477a-b06f-4036a78f2aef tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:50.118246 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-915cff38-d263-477a-b06f-4036a78f2aef tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:50.127192 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-915cff38-d263-477a-b06f-4036a78f2aef tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:50.127643 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-915cff38-d263-477a-b06f-4036a78f2aef tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:50.128439 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-915cff38-d263-477a-b06f-4036a78f2aef tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:50.128873 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-915cff38-d263-477a-b06f-4036a78f2aef tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:50.140381 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-26a5f478-b0bd-4c14-9a4e-cac7a826409f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:50.148750 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-26a5f478-b0bd-4c14-9a4e-cac7a826409f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1325 microversion: 2.1 time: 0.301778 Feb 16 14:25:50.153502 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 63/93] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:49 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1325 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:50.238062 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-915cff38-d263-477a-b06f-4036a78f2aef tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:50.256397 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-915cff38-d263-477a-b06f-4036a78f2aef tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:50.259372 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-915cff38-d263-477a-b06f-4036a78f2aef tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:50.274907 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-915cff38-d263-477a-b06f-4036a78f2aef tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1342 microversion: 2.20 time: 0.168291 Feb 16 14:25:50.276714 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 31/94] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:25:50 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1342 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:25:50.848856 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-f514b59c-c63a-4f4b-b2bc-cf866d2dd241 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:50.849783 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-f514b59c-c63a-4f4b-b2bc-cf866d2dd241 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:50.860454 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f514b59c-c63a-4f4b-b2bc-cf866d2dd241 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:50.860952 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f514b59c-c63a-4f4b-b2bc-cf866d2dd241 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:50.862980 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f514b59c-c63a-4f4b-b2bc-cf866d2dd241 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:50.863637 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f514b59c-c63a-4f4b-b2bc-cf866d2dd241 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:51.040906 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-f514b59c-c63a-4f4b-b2bc-cf866d2dd241 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:51.048546 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-f514b59c-c63a-4f4b-b2bc-cf866d2dd241 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1365 microversion: 2.1 time: 0.207077 Feb 16 14:25:51.049451 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 64/95] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:50 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1365 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:51.124658 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-cd04231e-0b58-4058-960b-a6d6b14313a4 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:51.127311 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-cd04231e-0b58-4058-960b-a6d6b14313a4 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:51.167551 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cd04231e-0b58-4058-960b-a6d6b14313a4 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:51.168042 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cd04231e-0b58-4058-960b-a6d6b14313a4 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:51.171613 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-0471406f-6c69-42ff-81b7-0c5df6f88ae1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:51.172400 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cd04231e-0b58-4058-960b-a6d6b14313a4 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:51.172719 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-0471406f-6c69-42ff-81b7-0c5df6f88ae1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:51.172926 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cd04231e-0b58-4058-960b-a6d6b14313a4 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:51.186148 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0471406f-6c69-42ff-81b7-0c5df6f88ae1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:51.188897 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0471406f-6c69-42ff-81b7-0c5df6f88ae1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:51.189905 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0471406f-6c69-42ff-81b7-0c5df6f88ae1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:51.192630 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0471406f-6c69-42ff-81b7-0c5df6f88ae1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:51.634646 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-cd04231e-0b58-4058-960b-a6d6b14313a4 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd701d137d5744a3ea6b17a8568da17c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d38e42748249e495e0d4f675a018a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:51.642516 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-cd04231e-0b58-4058-960b-a6d6b14313a4 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 200 len: 1319 microversion: 2.1 time: 0.525616 Feb 16 14:25:51.646164 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 32/96] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:51 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 1319 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:51.661316 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ae2c3714-80d4-4efa-92ed-155e8a976c80 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:51.662160 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ae2c3714-80d4-4efa-92ed-155e8a976c80 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:51.674205 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ae2c3714-80d4-4efa-92ed-155e8a976c80 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:51.681201 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ae2c3714-80d4-4efa-92ed-155e8a976c80 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:51.682314 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ae2c3714-80d4-4efa-92ed-155e8a976c80 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:51.682959 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ae2c3714-80d4-4efa-92ed-155e8a976c80 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:51.701966 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-0471406f-6c69-42ff-81b7-0c5df6f88ae1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:51.714618 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-0471406f-6c69-42ff-81b7-0c5df6f88ae1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1325 microversion: 2.1 time: 0.548193 Feb 16 14:25:51.717078 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 65/97] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:51 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1325 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:25:52.066256 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-49d21101-7fe6-4728-88b8-cd56ee70f691 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:52.067083 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-49d21101-7fe6-4728-88b8-cd56ee70f691 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:52.077308 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-49d21101-7fe6-4728-88b8-cd56ee70f691 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:52.078255 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-49d21101-7fe6-4728-88b8-cd56ee70f691 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:52.082369 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-49d21101-7fe6-4728-88b8-cd56ee70f691 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:52.083043 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-49d21101-7fe6-4728-88b8-cd56ee70f691 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:52.125341 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ae2c3714-80d4-4efa-92ed-155e8a976c80 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:52.140784 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ae2c3714-80d4-4efa-92ed-155e8a976c80 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:52.146858 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ae2c3714-80d4-4efa-92ed-155e8a976c80 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:52.151576 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ae2c3714-80d4-4efa-92ed-155e8a976c80 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1410 microversion: 2.20 time: 0.494278 Feb 16 14:25:52.159907 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 33/98] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:25:51 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1410 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:25:52.263245 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-e5f93ea6-0143-45b1-9ce1-fb6dcb003d0a req-6e2e96ab-c96d-4361-a9d6-492e0e7e19c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64a4628d-ace6-4282-948c-d3e154ba9f35", "tag": "03b4e298-5eed-4639-a433-5b0e77361bac"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:25:52.265245 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:25:52.265245 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: warnings.warn(msg) Feb 16 14:25:52.274560 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-e5f93ea6-0143-45b1-9ce1-fb6dcb003d0a req-6e2e96ab-c96d-4361-a9d6-492e0e7e19c4 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:52.275145 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-e5f93ea6-0143-45b1-9ce1-fb6dcb003d0a req-6e2e96ab-c96d-4361-a9d6-492e0e7e19c4 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:52.292676 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-e5f93ea6-0143-45b1-9ce1-fb6dcb003d0a req-6e2e96ab-c96d-4361-a9d6-492e0e7e19c4 service nova] Creating event network-changed:03b4e298-5eed-4639-a433-5b0e77361bac for instance 64a4628d-ace6-4282-948c-d3e154ba9f35 on hv-cinder-80473 Feb 16 14:25:52.303322 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-e5f93ea6-0143-45b1-9ce1-fb6dcb003d0a req-6e2e96ab-c96d-4361-a9d6-492e0e7e19c4 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137102 Feb 16 14:25:52.304081 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 34/99] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:25:52.498232 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-49d21101-7fe6-4728-88b8-cd56ee70f691 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:52.505748 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-49d21101-7fe6-4728-88b8-cd56ee70f691 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1365 microversion: 2.1 time: 0.444113 Feb 16 14:25:52.506330 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 66/100] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:52 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1365 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:25:52.667118 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-0b44c1bd-5401-48a3-bcf8-3f32b3ff16c4 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:52.667708 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-0b44c1bd-5401-48a3-bcf8-3f32b3ff16c4 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:52.674864 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0b44c1bd-5401-48a3-bcf8-3f32b3ff16c4 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:52.675311 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0b44c1bd-5401-48a3-bcf8-3f32b3ff16c4 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:52.676482 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0b44c1bd-5401-48a3-bcf8-3f32b3ff16c4 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:52.677017 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0b44c1bd-5401-48a3-bcf8-3f32b3ff16c4 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:52.737989 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-db1a086b-282d-4eb5-abdd-e0f7c7553606 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:52.738942 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-db1a086b-282d-4eb5-abdd-e0f7c7553606 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:52.748495 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-db1a086b-282d-4eb5-abdd-e0f7c7553606 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:52.749200 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-db1a086b-282d-4eb5-abdd-e0f7c7553606 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:52.750169 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-db1a086b-282d-4eb5-abdd-e0f7c7553606 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:52.750924 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-db1a086b-282d-4eb5-abdd-e0f7c7553606 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:52.953831 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-0b44c1bd-5401-48a3-bcf8-3f32b3ff16c4 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd701d137d5744a3ea6b17a8568da17c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d38e42748249e495e0d4f675a018a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:52.964425 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-0b44c1bd-5401-48a3-bcf8-3f32b3ff16c4 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 200 len: 1319 microversion: 2.1 time: 0.304685 Feb 16 14:25:52.965047 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 35/101] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:52 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 1319 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:52.978568 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-fbca5f61-0b39-4e93-af0a-e9fd08ee2da8 req-98df28c9-86a9-460a-b32c-ad3bbb759de3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2139817-3f2e-4e56-87d6-a56a2ca2f6f9", "tag": "e636434b-73f6-458a-9681-a71516b2260d"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:25:52.978568 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:25:52.978568 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: warnings.warn(msg) Feb 16 14:25:52.984930 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-fbca5f61-0b39-4e93-af0a-e9fd08ee2da8 req-98df28c9-86a9-460a-b32c-ad3bbb759de3 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:52.985382 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-fbca5f61-0b39-4e93-af0a-e9fd08ee2da8 req-98df28c9-86a9-460a-b32c-ad3bbb759de3 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:53.009639 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-fbca5f61-0b39-4e93-af0a-e9fd08ee2da8 req-98df28c9-86a9-460a-b32c-ad3bbb759de3 service nova] Creating event network-changed:e636434b-73f6-458a-9681-a71516b2260d for instance e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 on hv-cinder-80473 Feb 16 14:25:53.015544 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-fbca5f61-0b39-4e93-af0a-e9fd08ee2da8 req-98df28c9-86a9-460a-b32c-ad3bbb759de3 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042719 Feb 16 14:25:53.018032 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 36/102] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:25:53.029935 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-db1a086b-282d-4eb5-abdd-e0f7c7553606 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:53.039928 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-db1a086b-282d-4eb5-abdd-e0f7c7553606 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1325 microversion: 2.1 time: 0.307788 Feb 16 14:25:53.043713 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 67/103] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:52 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1325 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:25:53.178319 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-87d12698-1a62-4251-bc00-96b27cbfb73b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:53.180688 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-87d12698-1a62-4251-bc00-96b27cbfb73b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:53.188150 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-87d12698-1a62-4251-bc00-96b27cbfb73b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:53.188947 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-87d12698-1a62-4251-bc00-96b27cbfb73b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:53.190165 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-87d12698-1a62-4251-bc00-96b27cbfb73b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:53.190822 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-87d12698-1a62-4251-bc00-96b27cbfb73b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:53.528303 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-87d12698-1a62-4251-bc00-96b27cbfb73b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:53.532033 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-643bffaa-a697-4983-b654-5c4ffc40d4e6 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:53.532867 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-643bffaa-a697-4983-b654-5c4ffc40d4e6 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:53.546026 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-87d12698-1a62-4251-bc00-96b27cbfb73b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:53.549558 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-643bffaa-a697-4983-b654-5c4ffc40d4e6 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:53.550118 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-643bffaa-a697-4983-b654-5c4ffc40d4e6 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:53.552640 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-643bffaa-a697-4983-b654-5c4ffc40d4e6 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:53.552640 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-643bffaa-a697-4983-b654-5c4ffc40d4e6 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:53.553864 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-87d12698-1a62-4251-bc00-96b27cbfb73b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:53.556253 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-87d12698-1a62-4251-bc00-96b27cbfb73b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1410 microversion: 2.20 time: 0.382464 Feb 16 14:25:53.556839 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 37/104] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:25:53 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1410 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:25:53.816120 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-643bffaa-a697-4983-b654-5c4ffc40d4e6 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:53.824423 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-643bffaa-a697-4983-b654-5c4ffc40d4e6 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1365 microversion: 2.1 time: 0.304041 Feb 16 14:25:53.833991 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 68/105] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:53 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1365 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:53.983906 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-aad602eb-213c-42f8-af82-2ea39144674e tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:53.984865 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-aad602eb-213c-42f8-af82-2ea39144674e tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:53.993728 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-aad602eb-213c-42f8-af82-2ea39144674e tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:53.994171 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-aad602eb-213c-42f8-af82-2ea39144674e tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:53.994997 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-aad602eb-213c-42f8-af82-2ea39144674e tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:53.995429 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-aad602eb-213c-42f8-af82-2ea39144674e tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:54.055714 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-d1512d12-ef39-4694-8f3a-20a4fd5436ec tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:54.056360 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-d1512d12-ef39-4694-8f3a-20a4fd5436ec tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:54.063349 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d1512d12-ef39-4694-8f3a-20a4fd5436ec tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:54.063793 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d1512d12-ef39-4694-8f3a-20a4fd5436ec tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:54.064586 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d1512d12-ef39-4694-8f3a-20a4fd5436ec tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:54.065020 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d1512d12-ef39-4694-8f3a-20a4fd5436ec tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:54.448989 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-d1512d12-ef39-4694-8f3a-20a4fd5436ec tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:54.460913 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-d1512d12-ef39-4694-8f3a-20a4fd5436ec tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1325 microversion: 2.1 time: 0.408657 Feb 16 14:25:54.474837 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 69/106] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:54 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1325 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:25:54.481366 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-aad602eb-213c-42f8-af82-2ea39144674e tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd701d137d5744a3ea6b17a8568da17c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d38e42748249e495e0d4f675a018a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:54.491347 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-aad602eb-213c-42f8-af82-2ea39144674e tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 200 len: 1319 microversion: 2.1 time: 0.512363 Feb 16 14:25:54.492904 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 38/107] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:53 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 1319 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:54.576409 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-240fadd2-8b7e-41d5-8949-a29fd79c0f4f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:54.577175 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-240fadd2-8b7e-41d5-8949-a29fd79c0f4f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:54.589920 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-240fadd2-8b7e-41d5-8949-a29fd79c0f4f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:54.590366 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-240fadd2-8b7e-41d5-8949-a29fd79c0f4f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:54.596609 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-240fadd2-8b7e-41d5-8949-a29fd79c0f4f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:54.596609 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-240fadd2-8b7e-41d5-8949-a29fd79c0f4f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:54.787962 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-240fadd2-8b7e-41d5-8949-a29fd79c0f4f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:54.807382 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-240fadd2-8b7e-41d5-8949-a29fd79c0f4f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:54.809003 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-240fadd2-8b7e-41d5-8949-a29fd79c0f4f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:54.810495 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-240fadd2-8b7e-41d5-8949-a29fd79c0f4f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1410 microversion: 2.20 time: 0.238182 Feb 16 14:25:54.811584 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 70/108] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:25:54 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1410 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:25:54.842882 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-59c1468d-148c-4b9f-9333-f20605ae42a5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:54.843511 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-59c1468d-148c-4b9f-9333-f20605ae42a5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:54.849765 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-59c1468d-148c-4b9f-9333-f20605ae42a5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:54.850473 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-59c1468d-148c-4b9f-9333-f20605ae42a5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:54.852032 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-59c1468d-148c-4b9f-9333-f20605ae42a5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:54.853241 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-59c1468d-148c-4b9f-9333-f20605ae42a5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:55.080196 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-59c1468d-148c-4b9f-9333-f20605ae42a5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:55.096185 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-59c1468d-148c-4b9f-9333-f20605ae42a5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1365 microversion: 2.1 time: 0.257876 Feb 16 14:25:55.096927 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 39/109] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:54 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1365 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:55.479025 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-89ad72bc-5e72-4592-88ae-f6466d5e8de0 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:55.479689 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-89ad72bc-5e72-4592-88ae-f6466d5e8de0 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:55.486162 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-89ad72bc-5e72-4592-88ae-f6466d5e8de0 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:55.486729 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-89ad72bc-5e72-4592-88ae-f6466d5e8de0 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:55.487533 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-89ad72bc-5e72-4592-88ae-f6466d5e8de0 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:55.487977 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-89ad72bc-5e72-4592-88ae-f6466d5e8de0 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:55.508997 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-961628ad-dd5d-4a9d-afeb-8e274fabc412 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:55.509939 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-961628ad-dd5d-4a9d-afeb-8e274fabc412 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:55.516135 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-961628ad-dd5d-4a9d-afeb-8e274fabc412 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:55.516584 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-961628ad-dd5d-4a9d-afeb-8e274fabc412 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:55.517564 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-961628ad-dd5d-4a9d-afeb-8e274fabc412 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:55.517999 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-961628ad-dd5d-4a9d-afeb-8e274fabc412 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:55.652268 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-89ad72bc-5e72-4592-88ae-f6466d5e8de0 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:55.659884 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-89ad72bc-5e72-4592-88ae-f6466d5e8de0 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1325 microversion: 2.1 time: 0.185387 Feb 16 14:25:55.661294 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 71/110] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:55 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1325 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:55.721393 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-961628ad-dd5d-4a9d-afeb-8e274fabc412 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd701d137d5744a3ea6b17a8568da17c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d38e42748249e495e0d4f675a018a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:55.728811 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-961628ad-dd5d-4a9d-afeb-8e274fabc412 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 200 len: 1319 microversion: 2.1 time: 0.224252 Feb 16 14:25:55.729444 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 40/111] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:55 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:25:55.830562 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-cc1a4752-da81-4d17-be73-74f768de1abc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:55.831578 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-cc1a4752-da81-4d17-be73-74f768de1abc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:55.838242 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-cc1a4752-da81-4d17-be73-74f768de1abc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:55.841426 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-cc1a4752-da81-4d17-be73-74f768de1abc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:55.841426 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-cc1a4752-da81-4d17-be73-74f768de1abc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:55.841426 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-cc1a4752-da81-4d17-be73-74f768de1abc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:56.050798 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-cc1a4752-da81-4d17-be73-74f768de1abc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:56.059244 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-cc1a4752-da81-4d17-be73-74f768de1abc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:56.060871 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-cc1a4752-da81-4d17-be73-74f768de1abc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:56.062307 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-cc1a4752-da81-4d17-be73-74f768de1abc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1410 microversion: 2.20 time: 0.235357 Feb 16 14:25:56.062989 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 72/112] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:25:55 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1410 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:25:56.113294 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-90ba925a-e7d8-4f96-a142-2a7e4b3b095d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:56.113903 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-90ba925a-e7d8-4f96-a142-2a7e4b3b095d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:56.123371 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-90ba925a-e7d8-4f96-a142-2a7e4b3b095d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:56.123841 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-90ba925a-e7d8-4f96-a142-2a7e4b3b095d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:56.124704 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-90ba925a-e7d8-4f96-a142-2a7e4b3b095d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:56.125147 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-90ba925a-e7d8-4f96-a142-2a7e4b3b095d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:56.366268 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-90ba925a-e7d8-4f96-a142-2a7e4b3b095d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:56.374929 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-90ba925a-e7d8-4f96-a142-2a7e4b3b095d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1365 microversion: 2.1 time: 0.265340 Feb 16 14:25:56.382548 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 41/113] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:56 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1365 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:56.424994 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-74db6365-267c-483e-bec6-60c7e2b58458 req-7ed7a846-4760-4071-8c92-8ba4cde1f9c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5", "name": "network-vif-plugged", "status": "completed", "tag": "c1966fb6-188c-4fce-ae9a-a15dd7b2bc08"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:25:56.427196 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:25:56.427196 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:25:56.443637 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-74db6365-267c-483e-bec6-60c7e2b58458 req-7ed7a846-4760-4071-8c92-8ba4cde1f9c4 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:56.444110 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-74db6365-267c-483e-bec6-60c7e2b58458 req-7ed7a846-4760-4071-8c92-8ba4cde1f9c4 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:56.456114 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-74db6365-267c-483e-bec6-60c7e2b58458 req-7ed7a846-4760-4071-8c92-8ba4cde1f9c4 service nova] Creating event network-vif-plugged:c1966fb6-188c-4fce-ae9a-a15dd7b2bc08 for instance 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 on hv-cinder-80473 Feb 16 14:25:56.461173 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-74db6365-267c-483e-bec6-60c7e2b58458 req-7ed7a846-4760-4071-8c92-8ba4cde1f9c4 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.281361 Feb 16 14:25:56.461764 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 73/114] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:25:56.676261 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c65d8b29-50c1-4d1d-a890-0b59430df242 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:56.677448 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c65d8b29-50c1-4d1d-a890-0b59430df242 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:56.683504 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c65d8b29-50c1-4d1d-a890-0b59430df242 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:56.683965 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c65d8b29-50c1-4d1d-a890-0b59430df242 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:56.684733 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c65d8b29-50c1-4d1d-a890-0b59430df242 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:56.685382 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c65d8b29-50c1-4d1d-a890-0b59430df242 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:56.745859 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-29384934-4d1e-4138-be9c-39d352d54f3d tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:56.747556 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-29384934-4d1e-4138-be9c-39d352d54f3d tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:56.753967 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-29384934-4d1e-4138-be9c-39d352d54f3d tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:56.759261 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-29384934-4d1e-4138-be9c-39d352d54f3d tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:56.760366 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-29384934-4d1e-4138-be9c-39d352d54f3d tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:56.762528 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-29384934-4d1e-4138-be9c-39d352d54f3d tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:56.845917 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c65d8b29-50c1-4d1d-a890-0b59430df242 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:56.854365 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c65d8b29-50c1-4d1d-a890-0b59430df242 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1325 microversion: 2.1 time: 0.181642 Feb 16 14:25:56.855232 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 42/115] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:56 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1325 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:56.965900 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-29384934-4d1e-4138-be9c-39d352d54f3d tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd701d137d5744a3ea6b17a8568da17c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d38e42748249e495e0d4f675a018a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:56.973297 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-29384934-4d1e-4138-be9c-39d352d54f3d tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 200 len: 1319 microversion: 2.1 time: 0.231668 Feb 16 14:25:56.973871 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 74/116] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:56 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:25:57.080622 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-da828e4c-88ef-4daf-a16d-6d3ee5749cab tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:57.081498 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-da828e4c-88ef-4daf-a16d-6d3ee5749cab tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:57.091582 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-da828e4c-88ef-4daf-a16d-6d3ee5749cab tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:57.092035 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-da828e4c-88ef-4daf-a16d-6d3ee5749cab tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:57.092840 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-da828e4c-88ef-4daf-a16d-6d3ee5749cab tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:57.093277 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-da828e4c-88ef-4daf-a16d-6d3ee5749cab tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:57.266592 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-da828e4c-88ef-4daf-a16d-6d3ee5749cab tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:57.276835 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-da828e4c-88ef-4daf-a16d-6d3ee5749cab tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:57.278743 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-da828e4c-88ef-4daf-a16d-6d3ee5749cab tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:57.280276 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-da828e4c-88ef-4daf-a16d-6d3ee5749cab tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1410 microversion: 2.20 time: 0.203582 Feb 16 14:25:57.280967 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 43/117] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:25:57 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1410 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:25:57.392843 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-8df793f7-57d9-4b09-b87e-f4c062cd8742 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:57.393441 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-8df793f7-57d9-4b09-b87e-f4c062cd8742 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:57.399530 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8df793f7-57d9-4b09-b87e-f4c062cd8742 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:57.399969 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8df793f7-57d9-4b09-b87e-f4c062cd8742 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:57.400741 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8df793f7-57d9-4b09-b87e-f4c062cd8742 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:57.401165 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8df793f7-57d9-4b09-b87e-f4c062cd8742 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:57.539139 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-8df793f7-57d9-4b09-b87e-f4c062cd8742 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:57.546458 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-8df793f7-57d9-4b09-b87e-f4c062cd8742 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1365 microversion: 2.1 time: 0.157246 Feb 16 14:25:57.547085 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 75/118] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:57 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:57.872077 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-7dfbc00a-9623-4654-8b99-b455db984b04 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:57.873299 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-7dfbc00a-9623-4654-8b99-b455db984b04 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:57.880370 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7dfbc00a-9623-4654-8b99-b455db984b04 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:57.881080 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7dfbc00a-9623-4654-8b99-b455db984b04 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:57.881952 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7dfbc00a-9623-4654-8b99-b455db984b04 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:57.882420 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7dfbc00a-9623-4654-8b99-b455db984b04 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:57.990404 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-9f28aead-21ac-4dcf-ae4b-b9f1672ca205 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:57.991216 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-9f28aead-21ac-4dcf-ae4b-b9f1672ca205 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:57.998541 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9f28aead-21ac-4dcf-ae4b-b9f1672ca205 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:57.998716 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9f28aead-21ac-4dcf-ae4b-b9f1672ca205 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:57.999611 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9f28aead-21ac-4dcf-ae4b-b9f1672ca205 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:58.000134 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9f28aead-21ac-4dcf-ae4b-b9f1672ca205 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:58.020358 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-7dfbc00a-9623-4654-8b99-b455db984b04 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:58.031578 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-7dfbc00a-9623-4654-8b99-b455db984b04 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1325 microversion: 2.1 time: 0.163614 Feb 16 14:25:58.032153 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 44/119] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:57 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1325 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:58.161571 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-9f28aead-21ac-4dcf-ae4b-b9f1672ca205 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd701d137d5744a3ea6b17a8568da17c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d38e42748249e495e0d4f675a018a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:58.173291 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-9f28aead-21ac-4dcf-ae4b-b9f1672ca205 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 200 len: 1319 microversion: 2.1 time: 0.186507 Feb 16 14:25:58.174584 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 76/120] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:57 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:25:58.299984 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-23f75e59-8a7b-4337-9479-98182c887807 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:58.300850 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-23f75e59-8a7b-4337-9479-98182c887807 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:58.315330 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-23f75e59-8a7b-4337-9479-98182c887807 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:58.316244 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-23f75e59-8a7b-4337-9479-98182c887807 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:58.317297 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-23f75e59-8a7b-4337-9479-98182c887807 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:58.318492 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-23f75e59-8a7b-4337-9479-98182c887807 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:58.475484 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-797dba35-cfb5-4e47-b005-ede2fb8d58c0 req-43fbdddb-a012-451f-acac-568f7b43e187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05accb7b-6275-4c8e-a18b-69b67bdc1d8d", "name": "network-vif-plugged", "status": "completed", "tag": "9be133d6-37da-4b5d-bf19-f8153906954d"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:25:58.478193 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:25:58.478193 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:25:58.485237 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-797dba35-cfb5-4e47-b005-ede2fb8d58c0 req-43fbdddb-a012-451f-acac-568f7b43e187 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:58.485808 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-797dba35-cfb5-4e47-b005-ede2fb8d58c0 req-43fbdddb-a012-451f-acac-568f7b43e187 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:58.501492 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-797dba35-cfb5-4e47-b005-ede2fb8d58c0 req-43fbdddb-a012-451f-acac-568f7b43e187 service nova] Creating event network-vif-plugged:9be133d6-37da-4b5d-bf19-f8153906954d for instance 05accb7b-6275-4c8e-a18b-69b67bdc1d8d on hv-cinder-80473 Feb 16 14:25:58.506995 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-797dba35-cfb5-4e47-b005-ede2fb8d58c0 req-43fbdddb-a012-451f-acac-568f7b43e187 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035262 Feb 16 14:25:58.509658 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 77/121] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 14:25:58.563198 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-23f75e59-8a7b-4337-9479-98182c887807 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:58.567948 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-a71c4f88-d73d-4dc6-ab14-8be5f3b18974 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:58.570972 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-a71c4f88-d73d-4dc6-ab14-8be5f3b18974 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:58.585107 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-23f75e59-8a7b-4337-9479-98182c887807 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:58.588425 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-23f75e59-8a7b-4337-9479-98182c887807 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:58.588672 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a71c4f88-d73d-4dc6-ab14-8be5f3b18974 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:58.590339 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-23f75e59-8a7b-4337-9479-98182c887807 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1410 microversion: 2.20 time: 0.295567 Feb 16 14:25:58.590691 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a71c4f88-d73d-4dc6-ab14-8be5f3b18974 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:58.591598 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a71c4f88-d73d-4dc6-ab14-8be5f3b18974 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:58.592096 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a71c4f88-d73d-4dc6-ab14-8be5f3b18974 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:58.592750 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 45/122] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:25:58 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1410 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:25:58.748298 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-a71c4f88-d73d-4dc6-ab14-8be5f3b18974 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:58.756103 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-a71c4f88-d73d-4dc6-ab14-8be5f3b18974 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1365 microversion: 2.1 time: 0.195741 Feb 16 14:25:58.756669 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 78/123] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:58 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1365 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:59.048708 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b5d8b7d6-480a-45c3-bfc6-92efc783db7e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:59.049422 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b5d8b7d6-480a-45c3-bfc6-92efc783db7e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:59.056974 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b5d8b7d6-480a-45c3-bfc6-92efc783db7e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:59.058514 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b5d8b7d6-480a-45c3-bfc6-92efc783db7e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:59.059567 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b5d8b7d6-480a-45c3-bfc6-92efc783db7e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:59.060218 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b5d8b7d6-480a-45c3-bfc6-92efc783db7e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:59.190677 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-f170b4d4-173e-477e-b898-f5256b8a28e6 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:59.191807 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-f170b4d4-173e-477e-b898-f5256b8a28e6 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:59.199288 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f170b4d4-173e-477e-b898-f5256b8a28e6 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:59.200373 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f170b4d4-173e-477e-b898-f5256b8a28e6 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:59.201168 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f170b4d4-173e-477e-b898-f5256b8a28e6 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:59.202195 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f170b4d4-173e-477e-b898-f5256b8a28e6 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:59.231741 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b5d8b7d6-480a-45c3-bfc6-92efc783db7e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:59.239796 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b5d8b7d6-480a-45c3-bfc6-92efc783db7e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1325 microversion: 2.1 time: 0.194888 Feb 16 14:25:59.240597 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 46/124] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:59 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1325 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:59.353769 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-f170b4d4-173e-477e-b898-f5256b8a28e6 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd701d137d5744a3ea6b17a8568da17c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d38e42748249e495e0d4f675a018a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:59.361230 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-f170b4d4-173e-477e-b898-f5256b8a28e6 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 200 len: 1319 microversion: 2.1 time: 0.174379 Feb 16 14:25:59.362108 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 79/125] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:59 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:25:59.610584 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-616d754b-206d-4993-b05d-b9f2e0ee8a55 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:59.611533 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-616d754b-206d-4993-b05d-b9f2e0ee8a55 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:59.618389 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-616d754b-206d-4993-b05d-b9f2e0ee8a55 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:59.619070 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-616d754b-206d-4993-b05d-b9f2e0ee8a55 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:59.620026 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-616d754b-206d-4993-b05d-b9f2e0ee8a55 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:59.620464 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-616d754b-206d-4993-b05d-b9f2e0ee8a55 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:59.775920 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-c7350f79-48c7-4ea0-be11-103caf0c05af tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:25:59.776998 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-c7350f79-48c7-4ea0-be11-103caf0c05af tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:25:59.787550 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c7350f79-48c7-4ea0-be11-103caf0c05af tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:59.790053 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c7350f79-48c7-4ea0-be11-103caf0c05af tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:59.791913 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c7350f79-48c7-4ea0-be11-103caf0c05af tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:25:59.792364 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c7350f79-48c7-4ea0-be11-103caf0c05af tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:25:59.804497 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-616d754b-206d-4993-b05d-b9f2e0ee8a55 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:59.813129 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-616d754b-206d-4993-b05d-b9f2e0ee8a55 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:59.814914 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-616d754b-206d-4993-b05d-b9f2e0ee8a55 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:25:59.816214 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-616d754b-206d-4993-b05d-b9f2e0ee8a55 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1410 microversion: 2.20 time: 0.209366 Feb 16 14:25:59.818457 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 47/126] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:25:59 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1410 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:26:00.008770 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-c7350f79-48c7-4ea0-be11-103caf0c05af tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:00.016483 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-c7350f79-48c7-4ea0-be11-103caf0c05af tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1365 microversion: 2.1 time: 0.246904 Feb 16 14:26:00.017177 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 80/127] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:25:59 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1365 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:00.256371 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-eab7716c-10e8-402c-a2a1-05d47a3d379a tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:00.256999 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-eab7716c-10e8-402c-a2a1-05d47a3d379a tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:00.263487 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-eab7716c-10e8-402c-a2a1-05d47a3d379a tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:00.263932 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-eab7716c-10e8-402c-a2a1-05d47a3d379a tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:00.264704 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-eab7716c-10e8-402c-a2a1-05d47a3d379a tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:00.265156 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-eab7716c-10e8-402c-a2a1-05d47a3d379a tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:00.378916 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-e19f8d33-0fb5-4835-af22-d329b289c7b2 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:00.383286 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-e19f8d33-0fb5-4835-af22-d329b289c7b2 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:00.403373 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e19f8d33-0fb5-4835-af22-d329b289c7b2 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:00.405068 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e19f8d33-0fb5-4835-af22-d329b289c7b2 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:00.405912 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e19f8d33-0fb5-4835-af22-d329b289c7b2 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:00.406359 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e19f8d33-0fb5-4835-af22-d329b289c7b2 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:00.425325 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-eab7716c-10e8-402c-a2a1-05d47a3d379a tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:00.433604 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-eab7716c-10e8-402c-a2a1-05d47a3d379a tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1325 microversion: 2.1 time: 0.180785 Feb 16 14:26:00.434716 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 48/128] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:00 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1325 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:00.579849 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-e19f8d33-0fb5-4835-af22-d329b289c7b2 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd701d137d5744a3ea6b17a8568da17c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d38e42748249e495e0d4f675a018a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:00.587986 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-e19f8d33-0fb5-4835-af22-d329b289c7b2 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 200 len: 1319 microversion: 2.1 time: 0.212652 Feb 16 14:26:00.588568 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 81/129] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:00 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:00.839989 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a7b5cdfc-6e6b-46f5-a4c9-63099ce9d233 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:00.840592 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a7b5cdfc-6e6b-46f5-a4c9-63099ce9d233 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:00.846506 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a7b5cdfc-6e6b-46f5-a4c9-63099ce9d233 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:00.848409 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a7b5cdfc-6e6b-46f5-a4c9-63099ce9d233 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:00.848409 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a7b5cdfc-6e6b-46f5-a4c9-63099ce9d233 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:00.848409 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a7b5cdfc-6e6b-46f5-a4c9-63099ce9d233 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:00.986968 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a7b5cdfc-6e6b-46f5-a4c9-63099ce9d233 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:00.995513 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a7b5cdfc-6e6b-46f5-a4c9-63099ce9d233 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:00.997024 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a7b5cdfc-6e6b-46f5-a4c9-63099ce9d233 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:00.998168 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a7b5cdfc-6e6b-46f5-a4c9-63099ce9d233 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1410 microversion: 2.20 time: 0.162161 Feb 16 14:26:00.998765 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 49/130] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:26:00 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1410 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:26:01.032943 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-c4815e7e-9f25-43a3-aa39-094e3e67c9a9 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:01.033598 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-c4815e7e-9f25-43a3-aa39-094e3e67c9a9 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:01.040677 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c4815e7e-9f25-43a3-aa39-094e3e67c9a9 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:01.041178 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c4815e7e-9f25-43a3-aa39-094e3e67c9a9 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:01.042157 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c4815e7e-9f25-43a3-aa39-094e3e67c9a9 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:01.042792 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c4815e7e-9f25-43a3-aa39-094e3e67c9a9 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:01.213647 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-c4815e7e-9f25-43a3-aa39-094e3e67c9a9 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:01.221435 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-c4815e7e-9f25-43a3-aa39-094e3e67c9a9 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1365 microversion: 2.1 time: 0.192040 Feb 16 14:26:01.222248 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 82/131] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:01 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1365 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:01.450285 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-9098ae5d-d706-4d21-8445-7a9a68be4194 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:01.451110 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-9098ae5d-d706-4d21-8445-7a9a68be4194 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:01.458573 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9098ae5d-d706-4d21-8445-7a9a68be4194 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:01.462418 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9098ae5d-d706-4d21-8445-7a9a68be4194 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:01.462418 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9098ae5d-d706-4d21-8445-7a9a68be4194 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:01.462418 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9098ae5d-d706-4d21-8445-7a9a68be4194 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:01.604780 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-88ad154a-255e-4a5a-b84a-154ccc644f59 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:01.605299 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-9098ae5d-d706-4d21-8445-7a9a68be4194 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:01.613604 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-88ad154a-255e-4a5a-b84a-154ccc644f59 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:01.616194 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-9098ae5d-d706-4d21-8445-7a9a68be4194 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1325 microversion: 2.1 time: 0.169501 Feb 16 14:26:01.622061 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-88ad154a-255e-4a5a-b84a-154ccc644f59 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:01.629496 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-88ad154a-255e-4a5a-b84a-154ccc644f59 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:01.629496 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-88ad154a-255e-4a5a-b84a-154ccc644f59 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:01.629496 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-88ad154a-255e-4a5a-b84a-154ccc644f59 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:01.630699 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 50/132] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:01 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1325 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:01.771482 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-88ad154a-255e-4a5a-b84a-154ccc644f59 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd701d137d5744a3ea6b17a8568da17c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d38e42748249e495e0d4f675a018a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:01.779608 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-88ad154a-255e-4a5a-b84a-154ccc644f59 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 200 len: 1319 microversion: 2.1 time: 0.178915 Feb 16 14:26:01.780226 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 83/133] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:01 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:26:02.016664 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-beee5907-8e7d-4902-84fb-bf1e35ecaf5b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:02.017463 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-beee5907-8e7d-4902-84fb-bf1e35ecaf5b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:02.025000 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-beee5907-8e7d-4902-84fb-bf1e35ecaf5b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:02.039400 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-beee5907-8e7d-4902-84fb-bf1e35ecaf5b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:02.039400 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-beee5907-8e7d-4902-84fb-bf1e35ecaf5b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:02.039400 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-beee5907-8e7d-4902-84fb-bf1e35ecaf5b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:02.175861 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-beee5907-8e7d-4902-84fb-bf1e35ecaf5b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:02.188874 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-beee5907-8e7d-4902-84fb-bf1e35ecaf5b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:02.190556 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-beee5907-8e7d-4902-84fb-bf1e35ecaf5b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:02.192147 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-beee5907-8e7d-4902-84fb-bf1e35ecaf5b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1410 microversion: 2.20 time: 0.179107 Feb 16 14:26:02.204021 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 51/134] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:26:02 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1410 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:26:02.237947 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-8bb5a354-5b80-4d2b-a780-40650a1ee0a0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:02.238338 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-8bb5a354-5b80-4d2b-a780-40650a1ee0a0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:02.244763 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8bb5a354-5b80-4d2b-a780-40650a1ee0a0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:02.245203 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8bb5a354-5b80-4d2b-a780-40650a1ee0a0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:02.245981 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8bb5a354-5b80-4d2b-a780-40650a1ee0a0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:02.246413 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8bb5a354-5b80-4d2b-a780-40650a1ee0a0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:02.382955 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-8bb5a354-5b80-4d2b-a780-40650a1ee0a0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:02.391382 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-8bb5a354-5b80-4d2b-a780-40650a1ee0a0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1365 microversion: 2.1 time: 0.157247 Feb 16 14:26:02.399058 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 84/135] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:02 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:02.632903 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-8bb71fec-a16d-45da-ba30-ee43f631a491 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:02.633513 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-8bb71fec-a16d-45da-ba30-ee43f631a491 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:02.639474 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8bb71fec-a16d-45da-ba30-ee43f631a491 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:02.639921 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8bb71fec-a16d-45da-ba30-ee43f631a491 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:02.640773 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8bb71fec-a16d-45da-ba30-ee43f631a491 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:02.641212 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8bb71fec-a16d-45da-ba30-ee43f631a491 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:02.783715 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-8bb71fec-a16d-45da-ba30-ee43f631a491 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:02.793975 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-8bb71fec-a16d-45da-ba30-ee43f631a491 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1325 microversion: 2.1 time: 0.164637 Feb 16 14:26:02.794662 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 52/136] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:02 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1325 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:02.796475 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-d41f2209-95f7-4a79-820e-11375c6519a7 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:02.797076 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-d41f2209-95f7-4a79-820e-11375c6519a7 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:02.803627 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d41f2209-95f7-4a79-820e-11375c6519a7 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:02.804377 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d41f2209-95f7-4a79-820e-11375c6519a7 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:02.815954 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d41f2209-95f7-4a79-820e-11375c6519a7 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:02.816435 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d41f2209-95f7-4a79-820e-11375c6519a7 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:02.969389 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-d41f2209-95f7-4a79-820e-11375c6519a7 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd701d137d5744a3ea6b17a8568da17c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d38e42748249e495e0d4f675a018a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:02.977870 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-d41f2209-95f7-4a79-820e-11375c6519a7 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 200 len: 1319 microversion: 2.1 time: 0.185091 Feb 16 14:26:02.978463 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 85/137] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:02 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:26:03.211559 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a1cd086f-07f2-4763-8c00-23f5637df55c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:03.212165 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a1cd086f-07f2-4763-8c00-23f5637df55c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:03.217997 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a1cd086f-07f2-4763-8c00-23f5637df55c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:03.218443 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a1cd086f-07f2-4763-8c00-23f5637df55c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:03.219241 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a1cd086f-07f2-4763-8c00-23f5637df55c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:03.219669 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a1cd086f-07f2-4763-8c00-23f5637df55c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:03.352972 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a1cd086f-07f2-4763-8c00-23f5637df55c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:03.361068 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a1cd086f-07f2-4763-8c00-23f5637df55c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:03.362586 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a1cd086f-07f2-4763-8c00-23f5637df55c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:03.363837 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a1cd086f-07f2-4763-8c00-23f5637df55c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1410 microversion: 2.20 time: 0.156579 Feb 16 14:26:03.364404 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 53/138] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:26:03 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1410 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:26:03.413121 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-cbee57fe-c317-4e4b-83ed-6a74642a5b79 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:03.413931 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-cbee57fe-c317-4e4b-83ed-6a74642a5b79 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:03.419984 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-cbee57fe-c317-4e4b-83ed-6a74642a5b79 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:03.420422 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-cbee57fe-c317-4e4b-83ed-6a74642a5b79 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:03.421192 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-cbee57fe-c317-4e4b-83ed-6a74642a5b79 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:03.421638 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-cbee57fe-c317-4e4b-83ed-6a74642a5b79 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:03.558078 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-cbee57fe-c317-4e4b-83ed-6a74642a5b79 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:03.565388 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-cbee57fe-c317-4e4b-83ed-6a74642a5b79 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1365 microversion: 2.1 time: 0.155843 Feb 16 14:26:03.565946 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 86/139] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:03 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:03.811042 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-d40eea57-8450-4e1b-9c95-fe1258dc9875 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:03.811671 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-d40eea57-8450-4e1b-9c95-fe1258dc9875 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:03.817429 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d40eea57-8450-4e1b-9c95-fe1258dc9875 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:03.817878 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d40eea57-8450-4e1b-9c95-fe1258dc9875 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:03.818677 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d40eea57-8450-4e1b-9c95-fe1258dc9875 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:03.819159 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d40eea57-8450-4e1b-9c95-fe1258dc9875 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:03.969121 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d40eea57-8450-4e1b-9c95-fe1258dc9875 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:03.977975 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-d40eea57-8450-4e1b-9c95-fe1258dc9875 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1325 microversion: 2.1 time: 0.170034 Feb 16 14:26:03.978799 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 54/140] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:03 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1325 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:03.995152 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-4fd52e72-41a7-428f-b764-5d76292a543a tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:03.995748 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-4fd52e72-41a7-428f-b764-5d76292a543a tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:04.001759 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4fd52e72-41a7-428f-b764-5d76292a543a tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:04.003588 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4fd52e72-41a7-428f-b764-5d76292a543a tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:04.003588 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4fd52e72-41a7-428f-b764-5d76292a543a tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:04.003588 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4fd52e72-41a7-428f-b764-5d76292a543a tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:04.149448 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-4fd52e72-41a7-428f-b764-5d76292a543a tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd701d137d5744a3ea6b17a8568da17c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d38e42748249e495e0d4f675a018a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:04.161370 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-4fd52e72-41a7-428f-b764-5d76292a543a tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 200 len: 1319 microversion: 2.1 time: 0.165921 Feb 16 14:26:04.161370 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 87/141] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:03 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:04.382148 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a95f97b8-af56-43c5-a62a-c91c677ff73a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:04.383084 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a95f97b8-af56-43c5-a62a-c91c677ff73a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:04.388857 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a95f97b8-af56-43c5-a62a-c91c677ff73a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:04.389312 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a95f97b8-af56-43c5-a62a-c91c677ff73a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:04.390105 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a95f97b8-af56-43c5-a62a-c91c677ff73a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:04.390549 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a95f97b8-af56-43c5-a62a-c91c677ff73a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:04.524614 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a95f97b8-af56-43c5-a62a-c91c677ff73a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:04.532431 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a95f97b8-af56-43c5-a62a-c91c677ff73a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:04.533960 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a95f97b8-af56-43c5-a62a-c91c677ff73a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:04.535118 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a95f97b8-af56-43c5-a62a-c91c677ff73a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1410 microversion: 2.20 time: 0.156632 Feb 16 14:26:04.535689 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 55/142] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:26:04 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1410 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:26:04.583446 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-1e298c7b-c723-4829-90fa-a49fb0117bd3 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:04.584049 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-1e298c7b-c723-4829-90fa-a49fb0117bd3 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:04.591680 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1e298c7b-c723-4829-90fa-a49fb0117bd3 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:04.591680 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1e298c7b-c723-4829-90fa-a49fb0117bd3 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:04.592412 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1e298c7b-c723-4829-90fa-a49fb0117bd3 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:04.592836 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1e298c7b-c723-4829-90fa-a49fb0117bd3 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:04.729125 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-1e298c7b-c723-4829-90fa-a49fb0117bd3 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:04.739696 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-1e298c7b-c723-4829-90fa-a49fb0117bd3 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1365 microversion: 2.1 time: 0.160245 Feb 16 14:26:04.740275 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 88/143] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:04 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:04.994736 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-69d1106b-d2c6-4cbc-99a7-ed98f4806e24 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:04.995360 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-69d1106b-d2c6-4cbc-99a7-ed98f4806e24 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:05.001257 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-69d1106b-d2c6-4cbc-99a7-ed98f4806e24 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:05.001705 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-69d1106b-d2c6-4cbc-99a7-ed98f4806e24 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:05.002475 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-69d1106b-d2c6-4cbc-99a7-ed98f4806e24 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:05.002939 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-69d1106b-d2c6-4cbc-99a7-ed98f4806e24 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:05.127297 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-11c8c105-bd86-4ab5-883c-672663712a91 req-140b1979-a94c-4585-9a9b-fa0719772a32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dcd0641-a2af-472e-afdb-1b7c1c72666f", "name": "network-vif-plugged", "status": "completed", "tag": "47ff8a4b-9375-4563-92b3-af528e61b72f"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:26:05.129442 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:26:05.129442 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:26:05.135158 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-69d1106b-d2c6-4cbc-99a7-ed98f4806e24 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:05.137335 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-11c8c105-bd86-4ab5-883c-672663712a91 req-140b1979-a94c-4585-9a9b-fa0719772a32 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:05.137773 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-11c8c105-bd86-4ab5-883c-672663712a91 req-140b1979-a94c-4585-9a9b-fa0719772a32 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:05.142438 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-69d1106b-d2c6-4cbc-99a7-ed98f4806e24 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1325 microversion: 2.1 time: 0.151889 Feb 16 14:26:05.143042 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 56/144] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:04 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1325 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:05.148656 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-11c8c105-bd86-4ab5-883c-672663712a91 req-140b1979-a94c-4585-9a9b-fa0719772a32 service nova] Creating event network-vif-plugged:47ff8a4b-9375-4563-92b3-af528e61b72f for instance 3dcd0641-a2af-472e-afdb-1b7c1c72666f on hv-cinder-80473 Feb 16 14:26:05.153585 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-11c8c105-bd86-4ab5-883c-672663712a91 req-140b1979-a94c-4585-9a9b-fa0719772a32 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030540 Feb 16 14:26:05.154151 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 89/145] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:26:05.173629 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-9840dce4-44da-4e51-b5ec-f73b7bd0f83f tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:05.174235 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-9840dce4-44da-4e51-b5ec-f73b7bd0f83f tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:05.180911 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9840dce4-44da-4e51-b5ec-f73b7bd0f83f tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:05.181344 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9840dce4-44da-4e51-b5ec-f73b7bd0f83f tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:05.182160 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9840dce4-44da-4e51-b5ec-f73b7bd0f83f tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:05.182596 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9840dce4-44da-4e51-b5ec-f73b7bd0f83f tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:05.319707 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-9840dce4-44da-4e51-b5ec-f73b7bd0f83f tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd701d137d5744a3ea6b17a8568da17c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d38e42748249e495e0d4f675a018a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:05.327264 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-9840dce4-44da-4e51-b5ec-f73b7bd0f83f tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 200 len: 1319 microversion: 2.1 time: 0.157288 Feb 16 14:26:05.327832 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 57/146] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:05 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:05.552600 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-dc9631cd-713d-4af6-8680-d44f9d319f5d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:05.553321 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-dc9631cd-713d-4af6-8680-d44f9d319f5d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:05.560396 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-dc9631cd-713d-4af6-8680-d44f9d319f5d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:05.560850 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-dc9631cd-713d-4af6-8680-d44f9d319f5d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:05.561630 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-dc9631cd-713d-4af6-8680-d44f9d319f5d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:05.562064 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-dc9631cd-713d-4af6-8680-d44f9d319f5d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:05.701069 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-dc9631cd-713d-4af6-8680-d44f9d319f5d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:05.709197 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-dc9631cd-713d-4af6-8680-d44f9d319f5d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:05.711394 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-dc9631cd-713d-4af6-8680-d44f9d319f5d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:05.712491 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-dc9631cd-713d-4af6-8680-d44f9d319f5d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1410 microversion: 2.20 time: 0.163968 Feb 16 14:26:05.714298 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 90/147] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:26:05 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1410 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:26:05.756128 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-369b428a-2a9f-4b89-ac37-2bd84e71908f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:05.756747 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-369b428a-2a9f-4b89-ac37-2bd84e71908f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:05.762973 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-369b428a-2a9f-4b89-ac37-2bd84e71908f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:05.763431 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-369b428a-2a9f-4b89-ac37-2bd84e71908f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:05.764216 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-369b428a-2a9f-4b89-ac37-2bd84e71908f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:05.764657 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-369b428a-2a9f-4b89-ac37-2bd84e71908f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:05.898791 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-369b428a-2a9f-4b89-ac37-2bd84e71908f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:05.906249 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-369b428a-2a9f-4b89-ac37-2bd84e71908f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1365 microversion: 2.1 time: 0.153704 Feb 16 14:26:05.906884 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 58/148] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:05 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:06.158913 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-4867541d-1763-4506-af67-f3f7beec0ad1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:06.159849 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-4867541d-1763-4506-af67-f3f7beec0ad1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:06.166423 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4867541d-1763-4506-af67-f3f7beec0ad1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:06.166979 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4867541d-1763-4506-af67-f3f7beec0ad1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:06.167851 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4867541d-1763-4506-af67-f3f7beec0ad1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:06.168363 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4867541d-1763-4506-af67-f3f7beec0ad1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:06.331148 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-4867541d-1763-4506-af67-f3f7beec0ad1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:06.339369 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-4867541d-1763-4506-af67-f3f7beec0ad1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1325 microversion: 2.1 time: 0.184129 Feb 16 14:26:06.339944 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 91/149] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:06 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1325 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:06.343804 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c23d854f-2932-4664-8b1b-77ee4441494d tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:06.344422 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c23d854f-2932-4664-8b1b-77ee4441494d tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:06.350341 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c23d854f-2932-4664-8b1b-77ee4441494d tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:06.350990 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c23d854f-2932-4664-8b1b-77ee4441494d tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:06.352401 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c23d854f-2932-4664-8b1b-77ee4441494d tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:06.352918 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c23d854f-2932-4664-8b1b-77ee4441494d tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:06.493670 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c23d854f-2932-4664-8b1b-77ee4441494d tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd701d137d5744a3ea6b17a8568da17c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d38e42748249e495e0d4f675a018a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:06.501873 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c23d854f-2932-4664-8b1b-77ee4441494d tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 200 len: 1319 microversion: 2.1 time: 0.161441 Feb 16 14:26:06.510184 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 59/150] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:06 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:26:06.731192 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-bc3db617-b6bf-47d5-b564-57ba73f46b23 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:06.731976 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-bc3db617-b6bf-47d5-b564-57ba73f46b23 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:06.738482 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-bc3db617-b6bf-47d5-b564-57ba73f46b23 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:06.739323 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-bc3db617-b6bf-47d5-b564-57ba73f46b23 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:06.743325 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-bc3db617-b6bf-47d5-b564-57ba73f46b23 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:06.743325 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-bc3db617-b6bf-47d5-b564-57ba73f46b23 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:06.886156 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-bc3db617-b6bf-47d5-b564-57ba73f46b23 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:06.894114 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-bc3db617-b6bf-47d5-b564-57ba73f46b23 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:06.895748 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-bc3db617-b6bf-47d5-b564-57ba73f46b23 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:06.896932 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-bc3db617-b6bf-47d5-b564-57ba73f46b23 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1410 microversion: 2.20 time: 0.170747 Feb 16 14:26:06.897587 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 92/151] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:26:06 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1410 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:26:06.923703 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-af16083b-1dc8-49f7-8c29-75fafe1fcf8a tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:06.924315 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-af16083b-1dc8-49f7-8c29-75fafe1fcf8a tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:06.930482 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-af16083b-1dc8-49f7-8c29-75fafe1fcf8a tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:06.930983 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-af16083b-1dc8-49f7-8c29-75fafe1fcf8a tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:06.931768 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-af16083b-1dc8-49f7-8c29-75fafe1fcf8a tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:06.932214 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-af16083b-1dc8-49f7-8c29-75fafe1fcf8a tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:07.068927 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-af16083b-1dc8-49f7-8c29-75fafe1fcf8a tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:07.077712 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-af16083b-1dc8-49f7-8c29-75fafe1fcf8a tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1365 microversion: 2.1 time: 0.157750 Feb 16 14:26:07.078306 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 60/152] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:06 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:07.169520 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-fbc58548-4f90-4de4-b7ea-c2a3dd13cc2e req-7bb267a5-7ec4-4a75-af12-d865c6d30db9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2139817-3f2e-4e56-87d6-a56a2ca2f6f9", "name": "network-vif-plugged", "status": "completed", "tag": "e636434b-73f6-458a-9681-a71516b2260d"}, {"server_uuid": "64a4628d-ace6-4282-948c-d3e154ba9f35", "name": "network-vif-plugged", "status": "completed", "tag": "03b4e298-5eed-4639-a433-5b0e77361bac"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:26:07.171387 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:26:07.171387 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:26:07.179627 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-fbc58548-4f90-4de4-b7ea-c2a3dd13cc2e req-7bb267a5-7ec4-4a75-af12-d865c6d30db9 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:07.180232 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-fbc58548-4f90-4de4-b7ea-c2a3dd13cc2e req-7bb267a5-7ec4-4a75-af12-d865c6d30db9 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:07.192666 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-fbc58548-4f90-4de4-b7ea-c2a3dd13cc2e req-7bb267a5-7ec4-4a75-af12-d865c6d30db9 service nova] Creating event network-vif-plugged:e636434b-73f6-458a-9681-a71516b2260d for instance e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 on hv-cinder-80473 Feb 16 14:26:07.193213 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-fbc58548-4f90-4de4-b7ea-c2a3dd13cc2e req-7bb267a5-7ec4-4a75-af12-d865c6d30db9 service nova] Creating event network-vif-plugged:03b4e298-5eed-4639-a433-5b0e77361bac for instance 64a4628d-ace6-4282-948c-d3e154ba9f35 on hv-cinder-80473 Feb 16 14:26:07.200435 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-fbc58548-4f90-4de4-b7ea-c2a3dd13cc2e req-7bb267a5-7ec4-4a75-af12-d865c6d30db9 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034506 Feb 16 14:26:07.201016 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 93/153] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:26:07.356904 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b1fb43db-7ae0-4872-9388-5a43a21a4b9d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:07.358179 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b1fb43db-7ae0-4872-9388-5a43a21a4b9d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:07.364760 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b1fb43db-7ae0-4872-9388-5a43a21a4b9d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:07.365450 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b1fb43db-7ae0-4872-9388-5a43a21a4b9d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:07.366247 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b1fb43db-7ae0-4872-9388-5a43a21a4b9d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:07.367245 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b1fb43db-7ae0-4872-9388-5a43a21a4b9d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:07.516895 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b1fb43db-7ae0-4872-9388-5a43a21a4b9d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:07.524854 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b1fb43db-7ae0-4872-9388-5a43a21a4b9d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1325 microversion: 2.1 time: 0.172543 Feb 16 14:26:07.525430 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 61/154] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:07 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1325 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:07.526607 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-590007d5-e9bf-48cc-8363-b204c474800a tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:07.527294 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-590007d5-e9bf-48cc-8363-b204c474800a tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:07.533861 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-590007d5-e9bf-48cc-8363-b204c474800a tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:07.534332 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-590007d5-e9bf-48cc-8363-b204c474800a tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:07.535145 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-590007d5-e9bf-48cc-8363-b204c474800a tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:07.535579 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-590007d5-e9bf-48cc-8363-b204c474800a tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:07.684365 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-590007d5-e9bf-48cc-8363-b204c474800a tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd701d137d5744a3ea6b17a8568da17c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d38e42748249e495e0d4f675a018a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:07.691811 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-590007d5-e9bf-48cc-8363-b204c474800a tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 200 len: 1505 microversion: 2.1 time: 0.169679 Feb 16 14:26:07.692394 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 94/155] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:07 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 1505 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:26:07.915409 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-7a739563-9fa3-4708-aa11-abdb902793bc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:07.916015 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-7a739563-9fa3-4708-aa11-abdb902793bc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:07.921708 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7a739563-9fa3-4708-aa11-abdb902793bc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:07.922151 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7a739563-9fa3-4708-aa11-abdb902793bc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:07.922952 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7a739563-9fa3-4708-aa11-abdb902793bc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:07.923388 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7a739563-9fa3-4708-aa11-abdb902793bc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:08.062779 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-7a739563-9fa3-4708-aa11-abdb902793bc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:08.071100 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-7a739563-9fa3-4708-aa11-abdb902793bc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:08.072663 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-7a739563-9fa3-4708-aa11-abdb902793bc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:08.073780 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-7a739563-9fa3-4708-aa11-abdb902793bc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1410 microversion: 2.20 time: 0.162753 Feb 16 14:26:08.074332 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 62/156] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:26:07 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1410 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:26:08.094401 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-b67bf9dc-b410-4ab1-bede-029efc4faf9f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:08.095039 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-b67bf9dc-b410-4ab1-bede-029efc4faf9f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:08.100857 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b67bf9dc-b410-4ab1-bede-029efc4faf9f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:08.101306 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b67bf9dc-b410-4ab1-bede-029efc4faf9f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:08.102736 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b67bf9dc-b410-4ab1-bede-029efc4faf9f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:08.103274 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b67bf9dc-b410-4ab1-bede-029efc4faf9f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:08.251194 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-b67bf9dc-b410-4ab1-bede-029efc4faf9f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:08.259752 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-b67bf9dc-b410-4ab1-bede-029efc4faf9f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1365 microversion: 2.1 time: 0.168825 Feb 16 14:26:08.260355 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 95/157] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:08 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:08.541750 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-27a4eb51-7395-4d8d-8ac8-5062867daf8b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:08.543722 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-27a4eb51-7395-4d8d-8ac8-5062867daf8b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:08.548901 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-27a4eb51-7395-4d8d-8ac8-5062867daf8b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:08.549630 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-27a4eb51-7395-4d8d-8ac8-5062867daf8b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:08.550990 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-27a4eb51-7395-4d8d-8ac8-5062867daf8b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:08.551616 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-27a4eb51-7395-4d8d-8ac8-5062867daf8b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:08.720834 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-27a4eb51-7395-4d8d-8ac8-5062867daf8b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:08.728660 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-27a4eb51-7395-4d8d-8ac8-5062867daf8b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1325 microversion: 2.1 time: 0.191064 Feb 16 14:26:08.729209 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 63/158] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:08 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1325 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:09.091816 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-f4eab63d-751b-4821-a4ba-c4e8203111eb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:09.105355 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-f4eab63d-751b-4821-a4ba-c4e8203111eb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:09.105355 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f4eab63d-751b-4821-a4ba-c4e8203111eb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:09.105355 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f4eab63d-751b-4821-a4ba-c4e8203111eb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:09.105355 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f4eab63d-751b-4821-a4ba-c4e8203111eb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:09.105733 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f4eab63d-751b-4821-a4ba-c4e8203111eb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:09.235080 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-f4eab63d-751b-4821-a4ba-c4e8203111eb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:09.243548 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-f4eab63d-751b-4821-a4ba-c4e8203111eb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:09.245281 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-f4eab63d-751b-4821-a4ba-c4e8203111eb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:09.246377 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-f4eab63d-751b-4821-a4ba-c4e8203111eb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1410 microversion: 2.20 time: 0.158319 Feb 16 14:26:09.246970 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 96/159] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:26:09 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1410 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:26:09.276598 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-d8fce6fb-ff0f-4bba-ac43-f7a4a1ed6b06 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:09.277244 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-d8fce6fb-ff0f-4bba-ac43-f7a4a1ed6b06 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:09.283134 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d8fce6fb-ff0f-4bba-ac43-f7a4a1ed6b06 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:09.283588 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d8fce6fb-ff0f-4bba-ac43-f7a4a1ed6b06 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:09.284374 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d8fce6fb-ff0f-4bba-ac43-f7a4a1ed6b06 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:09.284815 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d8fce6fb-ff0f-4bba-ac43-f7a4a1ed6b06 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:09.425386 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d8fce6fb-ff0f-4bba-ac43-f7a4a1ed6b06 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:09.433098 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-d8fce6fb-ff0f-4bba-ac43-f7a4a1ed6b06 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1365 microversion: 2.1 time: 0.160260 Feb 16 14:26:09.433607 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 64/160] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:09 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:09.745136 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-035e8dfc-a623-464f-87ee-911bb9ec1d1d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:09.745741 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-035e8dfc-a623-464f-87ee-911bb9ec1d1d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:09.751543 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-035e8dfc-a623-464f-87ee-911bb9ec1d1d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:09.751992 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-035e8dfc-a623-464f-87ee-911bb9ec1d1d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:09.752772 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-035e8dfc-a623-464f-87ee-911bb9ec1d1d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:09.753206 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-035e8dfc-a623-464f-87ee-911bb9ec1d1d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:09.896078 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-035e8dfc-a623-464f-87ee-911bb9ec1d1d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:09.904197 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-035e8dfc-a623-464f-87ee-911bb9ec1d1d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1325 microversion: 2.1 time: 0.162875 Feb 16 14:26:09.904756 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 97/161] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:09 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1325 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:10.264469 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ac3be6db-9221-493b-ae7a-7f3bd1bb47f3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:10.265101 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ac3be6db-9221-493b-ae7a-7f3bd1bb47f3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:10.270887 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ac3be6db-9221-493b-ae7a-7f3bd1bb47f3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:10.271339 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ac3be6db-9221-493b-ae7a-7f3bd1bb47f3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:10.272138 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ac3be6db-9221-493b-ae7a-7f3bd1bb47f3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:10.272554 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ac3be6db-9221-493b-ae7a-7f3bd1bb47f3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:10.415827 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ac3be6db-9221-493b-ae7a-7f3bd1bb47f3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:10.423529 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ac3be6db-9221-493b-ae7a-7f3bd1bb47f3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:10.425036 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ac3be6db-9221-493b-ae7a-7f3bd1bb47f3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:10.426130 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ac3be6db-9221-493b-ae7a-7f3bd1bb47f3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1410 microversion: 2.20 time: 0.165444 Feb 16 14:26:10.426692 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 65/162] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:26:10 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1410 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:26:10.452038 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-8cf1a418-8c9d-49f5-a2e8-754b6c188654 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:10.452638 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-8cf1a418-8c9d-49f5-a2e8-754b6c188654 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:10.460586 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8cf1a418-8c9d-49f5-a2e8-754b6c188654 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:10.461650 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8cf1a418-8c9d-49f5-a2e8-754b6c188654 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:10.462486 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8cf1a418-8c9d-49f5-a2e8-754b6c188654 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:10.463130 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8cf1a418-8c9d-49f5-a2e8-754b6c188654 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:10.598313 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-8cf1a418-8c9d-49f5-a2e8-754b6c188654 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:10.606262 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-8cf1a418-8c9d-49f5-a2e8-754b6c188654 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1365 microversion: 2.1 time: 0.160469 Feb 16 14:26:10.608604 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 98/163] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:10 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:10.920605 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ea3765c0-84a7-4fb2-9da9-6366a7e2faea tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:10.921237 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ea3765c0-84a7-4fb2-9da9-6366a7e2faea tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:10.927007 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ea3765c0-84a7-4fb2-9da9-6366a7e2faea tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:10.927455 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ea3765c0-84a7-4fb2-9da9-6366a7e2faea tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:10.928298 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ea3765c0-84a7-4fb2-9da9-6366a7e2faea tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:10.928730 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ea3765c0-84a7-4fb2-9da9-6366a7e2faea tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:11.075529 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ea3765c0-84a7-4fb2-9da9-6366a7e2faea tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:11.083032 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ea3765c0-84a7-4fb2-9da9-6366a7e2faea tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1325 microversion: 2.1 time: 0.166002 Feb 16 14:26:11.083610 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 66/164] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:10 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1325 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:11.444815 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-a4c53783-6da4-43b5-b9ed-bcb8a09e4bb2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:11.445495 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-a4c53783-6da4-43b5-b9ed-bcb8a09e4bb2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:11.452434 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a4c53783-6da4-43b5-b9ed-bcb8a09e4bb2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:11.452874 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a4c53783-6da4-43b5-b9ed-bcb8a09e4bb2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:11.453641 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a4c53783-6da4-43b5-b9ed-bcb8a09e4bb2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:11.454060 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a4c53783-6da4-43b5-b9ed-bcb8a09e4bb2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:11.606725 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-a4c53783-6da4-43b5-b9ed-bcb8a09e4bb2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:11.623395 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-00771d37-184f-49eb-821f-795e4f24966e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:11.624684 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-00771d37-184f-49eb-821f-795e4f24966e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:11.625653 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-a4c53783-6da4-43b5-b9ed-bcb8a09e4bb2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:11.627231 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-a4c53783-6da4-43b5-b9ed-bcb8a09e4bb2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:11.628359 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-a4c53783-6da4-43b5-b9ed-bcb8a09e4bb2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1410 microversion: 2.20 time: 0.187413 Feb 16 14:26:11.628910 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 99/165] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:26:11 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1410 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:26:11.630550 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-00771d37-184f-49eb-821f-795e4f24966e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:11.632760 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-00771d37-184f-49eb-821f-795e4f24966e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:11.632760 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-00771d37-184f-49eb-821f-795e4f24966e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:11.632760 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-00771d37-184f-49eb-821f-795e4f24966e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:11.772102 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-00771d37-184f-49eb-821f-795e4f24966e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:11.780032 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-00771d37-184f-49eb-821f-795e4f24966e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1365 microversion: 2.1 time: 0.160169 Feb 16 14:26:11.781875 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 67/166] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:11 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:26:12.099612 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-ef2cc2ce-35a1-4e2a-b8ef-c5e673d19054 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:12.100218 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-ef2cc2ce-35a1-4e2a-b8ef-c5e673d19054 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:12.106307 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ef2cc2ce-35a1-4e2a-b8ef-c5e673d19054 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:12.106788 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ef2cc2ce-35a1-4e2a-b8ef-c5e673d19054 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:12.107604 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ef2cc2ce-35a1-4e2a-b8ef-c5e673d19054 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:12.108034 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ef2cc2ce-35a1-4e2a-b8ef-c5e673d19054 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:12.251412 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-ef2cc2ce-35a1-4e2a-b8ef-c5e673d19054 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:12.259819 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-ef2cc2ce-35a1-4e2a-b8ef-c5e673d19054 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1325 microversion: 2.1 time: 0.163509 Feb 16 14:26:12.260550 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 100/167] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:12 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1325 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:12.654677 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c8047f8f-eccb-445a-870b-c1a8a9294f46 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:12.655283 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c8047f8f-eccb-445a-870b-c1a8a9294f46 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:12.661514 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c8047f8f-eccb-445a-870b-c1a8a9294f46 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:12.662122 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c8047f8f-eccb-445a-870b-c1a8a9294f46 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:12.662937 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c8047f8f-eccb-445a-870b-c1a8a9294f46 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:12.663374 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c8047f8f-eccb-445a-870b-c1a8a9294f46 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:12.799024 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-66359dc2-15ee-4f11-8292-5575a1f5bbb0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:12.799674 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-66359dc2-15ee-4f11-8292-5575a1f5bbb0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:12.806187 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-66359dc2-15ee-4f11-8292-5575a1f5bbb0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:12.806568 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-66359dc2-15ee-4f11-8292-5575a1f5bbb0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:12.807777 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-66359dc2-15ee-4f11-8292-5575a1f5bbb0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:12.808367 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-66359dc2-15ee-4f11-8292-5575a1f5bbb0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:12.818989 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c8047f8f-eccb-445a-870b-c1a8a9294f46 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:12.828454 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c8047f8f-eccb-445a-870b-c1a8a9294f46 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:12.834858 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c8047f8f-eccb-445a-870b-c1a8a9294f46 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:12.836003 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c8047f8f-eccb-445a-870b-c1a8a9294f46 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1410 microversion: 2.20 time: 0.190982 Feb 16 14:26:12.837791 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 68/168] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:26:12 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1410 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:26:12.960521 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-66359dc2-15ee-4f11-8292-5575a1f5bbb0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:12.968326 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-66359dc2-15ee-4f11-8292-5575a1f5bbb0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1365 microversion: 2.1 time: 0.174415 Feb 16 14:26:12.968913 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 101/169] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:12 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:13.280379 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e4ea2565-f447-4f40-a9ff-709416b95d9f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:13.280379 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-e4ea2565-f447-4f40-a9ff-709416b95d9f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:13.283366 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e4ea2565-f447-4f40-a9ff-709416b95d9f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:13.283835 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e4ea2565-f447-4f40-a9ff-709416b95d9f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:13.284664 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e4ea2565-f447-4f40-a9ff-709416b95d9f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:13.285091 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e4ea2565-f447-4f40-a9ff-709416b95d9f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:13.425936 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-e4ea2565-f447-4f40-a9ff-709416b95d9f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:13.433795 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-e4ea2565-f447-4f40-a9ff-709416b95d9f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1519 microversion: 2.1 time: 0.160931 Feb 16 14:26:13.434429 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 69/170] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:13 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:13.453069 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-4ea40940-055a-4fc9-903b-5fc36eacaffc tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:26:13.454123 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-4ea40940-055a-4fc9-903b-5fc36eacaffc tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:13.460471 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4ea40940-055a-4fc9-903b-5fc36eacaffc tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:13.460969 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4ea40940-055a-4fc9-903b-5fc36eacaffc tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:13.461861 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4ea40940-055a-4fc9-903b-5fc36eacaffc tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:13.462287 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4ea40940-055a-4fc9-903b-5fc36eacaffc tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:13.526833 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.objects.instance [None req-4ea40940-055a-4fc9-903b-5fc36eacaffc tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lazy-loading 'flavor' on Instance uuid 3dcd0641-a2af-472e-afdb-1b7c1c72666f {{(pid=117031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:26:13.811818 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-fda82e4d-44c1-40f9-8c87-e2fa104fb6f4 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd5ec00d-5e49-4a97-b87d-c5a353291007"}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:26:13.811818 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-fda82e4d-44c1-40f9-8c87-e2fa104fb6f4 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:13.815180 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fda82e4d-44c1-40f9-8c87-e2fa104fb6f4 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:13.815715 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fda82e4d-44c1-40f9-8c87-e2fa104fb6f4 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:13.816509 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fda82e4d-44c1-40f9-8c87-e2fa104fb6f4 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:13.816945 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fda82e4d-44c1-40f9-8c87-e2fa104fb6f4 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:14.079795 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-4ea40940-055a-4fc9-903b-5fc36eacaffc tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "POST /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f/action" status: 200 len: 32 microversion: 2.1 time: 0.630594 Feb 16 14:26:14.080623 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 102/171] 10.222.0.110 () {60 vars in 1282 bytes} [Wed Feb 16 14:26:13 2022] POST /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f/action => generated 32 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 16 14:26:14.089540 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-71ef8420-4836-4072-8756-f4792515f562 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:14.090309 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-71ef8420-4836-4072-8756-f4792515f562 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:14.096435 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-71ef8420-4836-4072-8756-f4792515f562 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:14.096980 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-71ef8420-4836-4072-8756-f4792515f562 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:14.097774 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-71ef8420-4836-4072-8756-f4792515f562 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:14.098219 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-71ef8420-4836-4072-8756-f4792515f562 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:14.261051 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-71ef8420-4836-4072-8756-f4792515f562 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:14.268893 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-71ef8420-4836-4072-8756-f4792515f562 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:14.270407 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-71ef8420-4836-4072-8756-f4792515f562 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:14.271619 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-71ef8420-4836-4072-8756-f4792515f562 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1602 microversion: 2.20 time: 0.189752 Feb 16 14:26:14.272182 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 103/172] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:26:14 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1602 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:26:14.277114 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-3ce20d6d-278d-4e3b-8bf7-159908f9cfc0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:14.277909 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-3ce20d6d-278d-4e3b-8bf7-159908f9cfc0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:14.283623 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3ce20d6d-278d-4e3b-8bf7-159908f9cfc0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:14.284270 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3ce20d6d-278d-4e3b-8bf7-159908f9cfc0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:14.285107 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3ce20d6d-278d-4e3b-8bf7-159908f9cfc0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:14.285682 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3ce20d6d-278d-4e3b-8bf7-159908f9cfc0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:14.431117 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-3ce20d6d-278d-4e3b-8bf7-159908f9cfc0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:14.442251 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-3ce20d6d-278d-4e3b-8bf7-159908f9cfc0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1365 microversion: 2.1 time: 0.169059 Feb 16 14:26:14.442854 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 104/173] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:14 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:14.449054 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-3d2a5094-12e4-4769-9569-e4a6982eaa27 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:14.450225 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-3d2a5094-12e4-4769-9569-e4a6982eaa27 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:14.457055 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3d2a5094-12e4-4769-9569-e4a6982eaa27 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:14.457433 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3d2a5094-12e4-4769-9569-e4a6982eaa27 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:14.458207 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3d2a5094-12e4-4769-9569-e4a6982eaa27 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:14.458650 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3d2a5094-12e4-4769-9569-e4a6982eaa27 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:14.628341 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-3d2a5094-12e4-4769-9569-e4a6982eaa27 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:14.636580 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-3d2a5094-12e4-4769-9569-e4a6982eaa27 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1525 microversion: 2.1 time: 0.192705 Feb 16 14:26:14.637156 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 105/174] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:14 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1525 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:14.641570 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-7ddf56d0-a996-407e-a631-f157a7d471bb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:14.642057 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-7ddf56d0-a996-407e-a631-f157a7d471bb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:14.647813 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7ddf56d0-a996-407e-a631-f157a7d471bb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:14.648251 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7ddf56d0-a996-407e-a631-f157a7d471bb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:14.649059 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7ddf56d0-a996-407e-a631-f157a7d471bb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:14.649489 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7ddf56d0-a996-407e-a631-f157a7d471bb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:14.751827 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-7ddf56d0-a996-407e-a631-f157a7d471bb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.113612 Feb 16 14:26:14.752458 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 106/175] 10.222.0.110 () {60 vars in 1320 bytes} [Wed Feb 16 14:26:14 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9/os-interface => generated 285 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 16 14:26:15.095374 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-fda82e4d-44c1-40f9-8c87-e2fa104fb6f4 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "POST /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.292039 Feb 16 14:26:15.096674 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 70/176] 10.222.0.110 () {60 vars in 1327 bytes} [Wed Feb 16 14:26:13 2022] POST /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5/os-volume_attachments => generated 194 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 14:26:15.459507 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-e71d2ace-8282-4dd3-9751-bb2e8f488cc0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:15.460196 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-e71d2ace-8282-4dd3-9751-bb2e8f488cc0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:15.467838 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e71d2ace-8282-4dd3-9751-bb2e8f488cc0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:15.474782 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e71d2ace-8282-4dd3-9751-bb2e8f488cc0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:15.474782 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e71d2ace-8282-4dd3-9751-bb2e8f488cc0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:15.474782 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e71d2ace-8282-4dd3-9751-bb2e8f488cc0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:15.655587 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e1f460de-0c85-49fe-9ba9-4c1c2658dff7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:15.656769 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-e1f460de-0c85-49fe-9ba9-4c1c2658dff7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:15.662993 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e1f460de-0c85-49fe-9ba9-4c1c2658dff7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:15.663798 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e1f460de-0c85-49fe-9ba9-4c1c2658dff7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:15.665094 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e1f460de-0c85-49fe-9ba9-4c1c2658dff7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:15.665725 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e1f460de-0c85-49fe-9ba9-4c1c2658dff7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:15.889290 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-e71d2ace-8282-4dd3-9751-bb2e8f488cc0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:15.897602 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-e71d2ace-8282-4dd3-9751-bb2e8f488cc0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1551 microversion: 2.1 time: 0.442546 Feb 16 14:26:15.898177 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 107/177] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:15 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1551 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:15.914981 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-36ea8f37-34b2-42a7-b279-1979e95e3bc4 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:15.915676 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-36ea8f37-34b2-42a7-b279-1979e95e3bc4 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:15.922199 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-36ea8f37-34b2-42a7-b279-1979e95e3bc4 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:15.922422 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-36ea8f37-34b2-42a7-b279-1979e95e3bc4 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:15.923365 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-36ea8f37-34b2-42a7-b279-1979e95e3bc4 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:15.923902 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-36ea8f37-34b2-42a7-b279-1979e95e3bc4 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:15.949768 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-e1f460de-0c85-49fe-9ba9-4c1c2658dff7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:15.963943 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-e1f460de-0c85-49fe-9ba9-4c1c2658dff7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1525 microversion: 2.1 time: 0.311197 Feb 16 14:26:15.968045 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 71/178] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:15 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1525 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:26:16.128736 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-36ea8f37-34b2-42a7-b279-1979e95e3bc4 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.217777 Feb 16 14:26:16.129337 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 108/179] 10.222.0.110 () {58 vars in 1279 bytes} [Wed Feb 16 14:26:15 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35/os-interface => generated 284 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 14:26:16.523241 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-ae10b42a-3aaa-40b4-a175-1909ffe60dfd req-e213e896-d1bb-46b0-b44f-e671b803501b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2139817-3f2e-4e56-87d6-a56a2ca2f6f9", "tag": "e636434b-73f6-458a-9681-a71516b2260d"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:26:16.524124 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-9e38287d-ade6-46d4-9bee-d4fd166ea8d2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:16.524723 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-9e38287d-ade6-46d4-9bee-d4fd166ea8d2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:16.529299 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:26:16.529299 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:26:16.534971 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9e38287d-ade6-46d4-9bee-d4fd166ea8d2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:16.536293 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9e38287d-ade6-46d4-9bee-d4fd166ea8d2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:16.537738 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9e38287d-ade6-46d4-9bee-d4fd166ea8d2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:16.540511 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9e38287d-ade6-46d4-9bee-d4fd166ea8d2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:16.561902 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-ae10b42a-3aaa-40b4-a175-1909ffe60dfd req-e213e896-d1bb-46b0-b44f-e671b803501b service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:16.562556 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-ae10b42a-3aaa-40b4-a175-1909ffe60dfd req-e213e896-d1bb-46b0-b44f-e671b803501b service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:16.594348 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-ae10b42a-3aaa-40b4-a175-1909ffe60dfd req-e213e896-d1bb-46b0-b44f-e671b803501b service nova] Creating event network-changed:e636434b-73f6-458a-9681-a71516b2260d for instance e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 on hv-cinder-80473 Feb 16 14:26:16.599585 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-9e38287d-ade6-46d4-9bee-d4fd166ea8d2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9/ips" status: 200 len: 112 microversion: 2.20 time: 0.082185 Feb 16 14:26:16.609238 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 72/180] 10.222.0.110 () {60 vars in 1293 bytes} [Wed Feb 16 14:26:16 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9/ips => generated 112 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 16 14:26:16.629969 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-ae10b42a-3aaa-40b4-a175-1909ffe60dfd req-e213e896-d1bb-46b0-b44f-e671b803501b service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108151 Feb 16 14:26:16.633174 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 109/181] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:26:16.982564 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-93d08b23-1200-4ef4-a966-e040219f9c72 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:16.983298 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-93d08b23-1200-4ef4-a966-e040219f9c72 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:16.990909 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-93d08b23-1200-4ef4-a966-e040219f9c72 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:16.991364 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-93d08b23-1200-4ef4-a966-e040219f9c72 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:16.992151 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-93d08b23-1200-4ef4-a966-e040219f9c72 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:16.992892 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-93d08b23-1200-4ef4-a966-e040219f9c72 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:17.605637 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-93d08b23-1200-4ef4-a966-e040219f9c72 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:17.635558 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-93d08b23-1200-4ef4-a966-e040219f9c72 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1525 microversion: 2.1 time: 0.657161 Feb 16 14:26:17.636622 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 73/182] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:16 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1525 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:18.124710 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-8c744740-f08e-4a21-b7e8-4eeed694f6d2 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:18.129942 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-c401ec37-99a4-4a36-bfc2-6be9f2e93325 req-0467ad95-6e4f-4839-a70f-8e47a6f50f0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64a4628d-ace6-4282-948c-d3e154ba9f35", "tag": "03b4e298-5eed-4639-a433-5b0e77361bac"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:26:18.130369 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-8c744740-f08e-4a21-b7e8-4eeed694f6d2 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:18.130466 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:26:18.130466 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: warnings.warn(msg) Feb 16 14:26:18.140660 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-c401ec37-99a4-4a36-bfc2-6be9f2e93325 req-0467ad95-6e4f-4839-a70f-8e47a6f50f0d service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:18.145080 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-c401ec37-99a4-4a36-bfc2-6be9f2e93325 req-0467ad95-6e4f-4839-a70f-8e47a6f50f0d service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:18.152668 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8c744740-f08e-4a21-b7e8-4eeed694f6d2 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:18.155502 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8c744740-f08e-4a21-b7e8-4eeed694f6d2 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:18.157873 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8c744740-f08e-4a21-b7e8-4eeed694f6d2 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:18.158459 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8c744740-f08e-4a21-b7e8-4eeed694f6d2 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:18.170861 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-c401ec37-99a4-4a36-bfc2-6be9f2e93325 req-0467ad95-6e4f-4839-a70f-8e47a6f50f0d service nova] Creating event network-changed:03b4e298-5eed-4639-a433-5b0e77361bac for instance 64a4628d-ace6-4282-948c-d3e154ba9f35 on hv-cinder-80473 Feb 16 14:26:18.181436 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-c401ec37-99a4-4a36-bfc2-6be9f2e93325 req-0467ad95-6e4f-4839-a70f-8e47a6f50f0d service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060359 Feb 16 14:26:18.192893 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 74/183] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 14:26:18.201196 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-8c744740-f08e-4a21-b7e8-4eeed694f6d2 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35/ips" status: 200 len: 106 microversion: 2.1 time: 0.083638 Feb 16 14:26:18.201778 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 110/184] 10.222.0.110 () {58 vars in 1252 bytes} [Wed Feb 16 14:26:18 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35/ips => generated 106 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:26:18.656416 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-17ef1f75-7a9d-4967-84aa-ef68a894f185 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:18.657116 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-17ef1f75-7a9d-4967-84aa-ef68a894f185 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:18.669573 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-17ef1f75-7a9d-4967-84aa-ef68a894f185 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:18.670958 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-17ef1f75-7a9d-4967-84aa-ef68a894f185 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:18.672271 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-17ef1f75-7a9d-4967-84aa-ef68a894f185 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:18.672719 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-17ef1f75-7a9d-4967-84aa-ef68a894f185 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:19.535024 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-17ef1f75-7a9d-4967-84aa-ef68a894f185 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:19.543478 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-17ef1f75-7a9d-4967-84aa-ef68a894f185 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1525 microversion: 2.1 time: 0.891473 Feb 16 14:26:19.548977 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 75/185] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:18 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1525 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:20.560899 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-280e6434-906f-4709-9756-cf25e38f47ff tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:20.561463 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-280e6434-906f-4709-9756-cf25e38f47ff tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:20.567535 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-280e6434-906f-4709-9756-cf25e38f47ff tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:20.567979 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-280e6434-906f-4709-9756-cf25e38f47ff tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:20.568748 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-280e6434-906f-4709-9756-cf25e38f47ff tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:20.569273 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-280e6434-906f-4709-9756-cf25e38f47ff tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:20.718557 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-280e6434-906f-4709-9756-cf25e38f47ff tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:20.722442 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-280e6434-906f-4709-9756-cf25e38f47ff tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1525 microversion: 2.1 time: 0.165108 Feb 16 14:26:20.723030 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 111/186] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:20 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1525 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:21.739385 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-78fbaad3-2b78-4cc6-a2ee-6666e8bc6152 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:21.740812 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-78fbaad3-2b78-4cc6-a2ee-6666e8bc6152 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:21.750040 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-78fbaad3-2b78-4cc6-a2ee-6666e8bc6152 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:21.751220 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-78fbaad3-2b78-4cc6-a2ee-6666e8bc6152 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:21.753259 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-78fbaad3-2b78-4cc6-a2ee-6666e8bc6152 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:21.754008 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-78fbaad3-2b78-4cc6-a2ee-6666e8bc6152 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:21.904006 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-78fbaad3-2b78-4cc6-a2ee-6666e8bc6152 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:21.913653 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-78fbaad3-2b78-4cc6-a2ee-6666e8bc6152 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1525 microversion: 2.1 time: 0.178364 Feb 16 14:26:21.923179 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 76/187] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:21 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1525 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:22.930679 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-f5b203b3-7ee9-4910-a015-79b1c2eb2219 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:22.931936 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-f5b203b3-7ee9-4910-a015-79b1c2eb2219 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:22.937802 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f5b203b3-7ee9-4910-a015-79b1c2eb2219 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:22.938365 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f5b203b3-7ee9-4910-a015-79b1c2eb2219 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:22.939240 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f5b203b3-7ee9-4910-a015-79b1c2eb2219 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:22.939590 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f5b203b3-7ee9-4910-a015-79b1c2eb2219 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:23.072887 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-f5b203b3-7ee9-4910-a015-79b1c2eb2219 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:23.080398 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-f5b203b3-7ee9-4910-a015-79b1c2eb2219 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1525 microversion: 2.1 time: 0.153598 Feb 16 14:26:23.080969 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 112/188] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:22 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1525 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:24.096953 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-4a0df694-bc5e-4fca-998f-bec523e6a593 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:24.097554 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-4a0df694-bc5e-4fca-998f-bec523e6a593 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:24.104340 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4a0df694-bc5e-4fca-998f-bec523e6a593 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:24.104795 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4a0df694-bc5e-4fca-998f-bec523e6a593 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:24.105608 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4a0df694-bc5e-4fca-998f-bec523e6a593 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:24.106049 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4a0df694-bc5e-4fca-998f-bec523e6a593 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:24.236410 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-4a0df694-bc5e-4fca-998f-bec523e6a593 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:24.243685 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-4a0df694-bc5e-4fca-998f-bec523e6a593 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1525 microversion: 2.1 time: 0.150227 Feb 16 14:26:24.244979 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 77/189] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:24 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1525 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:25.261125 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-e5ec675f-1325-4f72-970c-d93c09c3d92c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:25.261720 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-e5ec675f-1325-4f72-970c-d93c09c3d92c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:25.267670 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e5ec675f-1325-4f72-970c-d93c09c3d92c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:25.268113 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e5ec675f-1325-4f72-970c-d93c09c3d92c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:25.268883 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e5ec675f-1325-4f72-970c-d93c09c3d92c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:25.269308 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e5ec675f-1325-4f72-970c-d93c09c3d92c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:25.400794 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-e5ec675f-1325-4f72-970c-d93c09c3d92c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:25.408033 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-e5ec675f-1325-4f72-970c-d93c09c3d92c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1525 microversion: 2.1 time: 0.150837 Feb 16 14:26:25.408613 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 113/190] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:25 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1525 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:26.425461 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ea938158-8c8c-4e36-a69e-d0e01afcaefd tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:26.434973 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ea938158-8c8c-4e36-a69e-d0e01afcaefd tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:26.442573 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ea938158-8c8c-4e36-a69e-d0e01afcaefd tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:26.443183 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ea938158-8c8c-4e36-a69e-d0e01afcaefd tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:26.444011 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ea938158-8c8c-4e36-a69e-d0e01afcaefd tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:26.444453 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ea938158-8c8c-4e36-a69e-d0e01afcaefd tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:26.577993 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ea938158-8c8c-4e36-a69e-d0e01afcaefd tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:26.585523 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ea938158-8c8c-4e36-a69e-d0e01afcaefd tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1525 microversion: 2.1 time: 0.164351 Feb 16 14:26:26.586088 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 78/191] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:26 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1525 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:27.602137 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-47c016c0-869e-4dc8-87f2-8e54ae889119 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:27.603139 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-47c016c0-869e-4dc8-87f2-8e54ae889119 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:27.609197 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-47c016c0-869e-4dc8-87f2-8e54ae889119 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:27.609646 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-47c016c0-869e-4dc8-87f2-8e54ae889119 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:27.610454 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-47c016c0-869e-4dc8-87f2-8e54ae889119 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:27.610920 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-47c016c0-869e-4dc8-87f2-8e54ae889119 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:27.745906 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-47c016c0-869e-4dc8-87f2-8e54ae889119 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:27.753068 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-47c016c0-869e-4dc8-87f2-8e54ae889119 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1525 microversion: 2.1 time: 0.154624 Feb 16 14:26:27.753635 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 114/192] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:27 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1525 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:28.769643 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-dd7f4d22-7a47-4666-8c96-29d4a692fc2a tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:28.770212 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-dd7f4d22-7a47-4666-8c96-29d4a692fc2a tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:28.777275 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dd7f4d22-7a47-4666-8c96-29d4a692fc2a tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:28.777719 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dd7f4d22-7a47-4666-8c96-29d4a692fc2a tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:28.778492 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dd7f4d22-7a47-4666-8c96-29d4a692fc2a tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:28.778958 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dd7f4d22-7a47-4666-8c96-29d4a692fc2a tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:28.911311 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-dd7f4d22-7a47-4666-8c96-29d4a692fc2a tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:28.918547 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-dd7f4d22-7a47-4666-8c96-29d4a692fc2a tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1525 microversion: 2.1 time: 0.152672 Feb 16 14:26:28.919138 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 79/193] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:28 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1525 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:29.935065 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-5fe5554e-ea7a-407c-8e6b-9ac11cd51ef7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:29.935668 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-5fe5554e-ea7a-407c-8e6b-9ac11cd51ef7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:29.941506 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5fe5554e-ea7a-407c-8e6b-9ac11cd51ef7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:29.941951 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5fe5554e-ea7a-407c-8e6b-9ac11cd51ef7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:29.942752 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5fe5554e-ea7a-407c-8e6b-9ac11cd51ef7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:29.943189 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5fe5554e-ea7a-407c-8e6b-9ac11cd51ef7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:30.078271 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-5fe5554e-ea7a-407c-8e6b-9ac11cd51ef7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:30.085923 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-5fe5554e-ea7a-407c-8e6b-9ac11cd51ef7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1525 microversion: 2.1 time: 0.154931 Feb 16 14:26:30.086431 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 115/194] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:29 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1525 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:31.103742 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-3bb1e80e-ba49-4138-83f0-e11e1c4c7ca4 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:31.104336 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-3bb1e80e-ba49-4138-83f0-e11e1c4c7ca4 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:31.110590 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3bb1e80e-ba49-4138-83f0-e11e1c4c7ca4 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:31.111064 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3bb1e80e-ba49-4138-83f0-e11e1c4c7ca4 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:31.111831 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3bb1e80e-ba49-4138-83f0-e11e1c4c7ca4 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:31.112258 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3bb1e80e-ba49-4138-83f0-e11e1c4c7ca4 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:31.244591 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3bb1e80e-ba49-4138-83f0-e11e1c4c7ca4 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:31.251725 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-3bb1e80e-ba49-4138-83f0-e11e1c4c7ca4 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1525 microversion: 2.1 time: 0.151773 Feb 16 14:26:31.252285 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 80/195] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:31 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1525 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:32.267990 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-858dcc99-c233-4b1c-80cf-fdeb53e23171 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:32.268647 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-858dcc99-c233-4b1c-80cf-fdeb53e23171 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:32.275321 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-858dcc99-c233-4b1c-80cf-fdeb53e23171 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:32.276050 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-858dcc99-c233-4b1c-80cf-fdeb53e23171 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:32.276841 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-858dcc99-c233-4b1c-80cf-fdeb53e23171 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:32.277316 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-858dcc99-c233-4b1c-80cf-fdeb53e23171 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:32.409824 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-858dcc99-c233-4b1c-80cf-fdeb53e23171 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:32.417090 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-858dcc99-c233-4b1c-80cf-fdeb53e23171 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1525 microversion: 2.1 time: 0.152754 Feb 16 14:26:32.417655 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 116/196] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:32 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1525 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:33.433134 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f79cbef7-7208-472e-85f6-a62792fee9f1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:33.433738 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f79cbef7-7208-472e-85f6-a62792fee9f1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:33.440313 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f79cbef7-7208-472e-85f6-a62792fee9f1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:33.440698 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f79cbef7-7208-472e-85f6-a62792fee9f1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:33.441494 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f79cbef7-7208-472e-85f6-a62792fee9f1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:33.441927 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f79cbef7-7208-472e-85f6-a62792fee9f1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:33.578301 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f79cbef7-7208-472e-85f6-a62792fee9f1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:33.586731 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f79cbef7-7208-472e-85f6-a62792fee9f1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1525 microversion: 2.1 time: 0.157307 Feb 16 14:26:33.587951 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 81/197] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:33 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1525 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:34.603149 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-28554aaf-ce91-413f-8249-16c2cd7ed413 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:34.603666 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-28554aaf-ce91-413f-8249-16c2cd7ed413 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:34.609483 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-28554aaf-ce91-413f-8249-16c2cd7ed413 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:34.609923 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-28554aaf-ce91-413f-8249-16c2cd7ed413 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:34.610710 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-28554aaf-ce91-413f-8249-16c2cd7ed413 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:34.611141 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-28554aaf-ce91-413f-8249-16c2cd7ed413 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:34.739322 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-28554aaf-ce91-413f-8249-16c2cd7ed413 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:34.746602 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-28554aaf-ce91-413f-8249-16c2cd7ed413 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1525 microversion: 2.1 time: 0.147210 Feb 16 14:26:34.747203 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 117/198] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:34 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1525 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:34.887569 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-157876fc-9f40-4a53-bf57-9c65cc84c6ab tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:34.888350 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-157876fc-9f40-4a53-bf57-9c65cc84c6ab tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:34.894718 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-157876fc-9f40-4a53-bf57-9c65cc84c6ab tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:34.895174 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-157876fc-9f40-4a53-bf57-9c65cc84c6ab tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:34.895957 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-157876fc-9f40-4a53-bf57-9c65cc84c6ab tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:34.896397 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-157876fc-9f40-4a53-bf57-9c65cc84c6ab tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:34.921243 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-157876fc-9f40-4a53-bf57-9c65cc84c6ab tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Going to try to terminate instance {{(pid=117032) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 16 14:26:35.274913 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-157876fc-9f40-4a53-bf57-9c65cc84c6ab tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "DELETE /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 204 len: 0 microversion: 2.1 time: 0.391350 Feb 16 14:26:35.275676 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 82/199] 10.222.0.110 () {58 vars in 1243 bytes} [Wed Feb 16 14:26:34 2022] DELETE /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 16 14:26:35.283499 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-82e4285e-f4a5-4dc3-a8d4-eabb83e25618 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:35.284098 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-82e4285e-f4a5-4dc3-a8d4-eabb83e25618 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:35.290442 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-82e4285e-f4a5-4dc3-a8d4-eabb83e25618 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:35.291246 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-82e4285e-f4a5-4dc3-a8d4-eabb83e25618 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:35.292090 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-82e4285e-f4a5-4dc3-a8d4-eabb83e25618 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:35.292521 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-82e4285e-f4a5-4dc3-a8d4-eabb83e25618 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:35.425673 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-82e4285e-f4a5-4dc3-a8d4-eabb83e25618 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd701d137d5744a3ea6b17a8568da17c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d38e42748249e495e0d4f675a018a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:35.434261 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-82e4285e-f4a5-4dc3-a8d4-eabb83e25618 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 200 len: 1557 microversion: 2.1 time: 0.154336 Feb 16 14:26:35.434937 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 118/200] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:35 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:35.764125 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e84e4ffb-7b98-4b5a-a4cb-09066d2dcc0e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:35.764749 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-e84e4ffb-7b98-4b5a-a4cb-09066d2dcc0e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:35.770809 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e84e4ffb-7b98-4b5a-a4cb-09066d2dcc0e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:35.771266 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e84e4ffb-7b98-4b5a-a4cb-09066d2dcc0e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:35.772052 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e84e4ffb-7b98-4b5a-a4cb-09066d2dcc0e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:35.772492 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e84e4ffb-7b98-4b5a-a4cb-09066d2dcc0e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:35.907530 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-e84e4ffb-7b98-4b5a-a4cb-09066d2dcc0e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:35.914743 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-e84e4ffb-7b98-4b5a-a4cb-09066d2dcc0e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1525 microversion: 2.1 time: 0.154843 Feb 16 14:26:35.915857 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 83/201] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:35 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1525 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:36.451681 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-961ec0b1-a612-4092-be51-d4ae2f87a3ef tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:36.452285 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-961ec0b1-a612-4092-be51-d4ae2f87a3ef tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:36.458448 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-961ec0b1-a612-4092-be51-d4ae2f87a3ef tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:36.458934 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-961ec0b1-a612-4092-be51-d4ae2f87a3ef tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:36.459730 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-961ec0b1-a612-4092-be51-d4ae2f87a3ef tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:36.460167 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-961ec0b1-a612-4092-be51-d4ae2f87a3ef tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:36.600103 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-961ec0b1-a612-4092-be51-d4ae2f87a3ef tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd701d137d5744a3ea6b17a8568da17c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d38e42748249e495e0d4f675a018a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:36.608836 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-961ec0b1-a612-4092-be51-d4ae2f87a3ef tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 200 len: 1557 microversion: 2.1 time: 0.160862 Feb 16 14:26:36.609410 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 119/202] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:36 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 1557 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:36.931768 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e994887c-2205-4325-a10a-61fda7d52931 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:36.932372 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-e994887c-2205-4325-a10a-61fda7d52931 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:36.938317 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e994887c-2205-4325-a10a-61fda7d52931 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:36.938787 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e994887c-2205-4325-a10a-61fda7d52931 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:36.939552 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e994887c-2205-4325-a10a-61fda7d52931 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:36.939983 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e994887c-2205-4325-a10a-61fda7d52931 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:37.078897 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-e994887c-2205-4325-a10a-61fda7d52931 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:37.086547 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-e994887c-2205-4325-a10a-61fda7d52931 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1525 microversion: 2.1 time: 0.158473 Feb 16 14:26:37.087328 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 84/203] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:36 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1525 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:37.625358 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-62fd1eb7-6d89-401f-b80c-53b5623c2884 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:37.625951 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-62fd1eb7-6d89-401f-b80c-53b5623c2884 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:37.631814 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-62fd1eb7-6d89-401f-b80c-53b5623c2884 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:37.632253 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-62fd1eb7-6d89-401f-b80c-53b5623c2884 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:37.633185 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-62fd1eb7-6d89-401f-b80c-53b5623c2884 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:37.633654 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-62fd1eb7-6d89-401f-b80c-53b5623c2884 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:37.763985 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-62fd1eb7-6d89-401f-b80c-53b5623c2884 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd701d137d5744a3ea6b17a8568da17c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d38e42748249e495e0d4f675a018a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:37.771894 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-62fd1eb7-6d89-401f-b80c-53b5623c2884 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 200 len: 1557 microversion: 2.1 time: 0.150194 Feb 16 14:26:37.772453 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 120/204] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:37 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:38.104172 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-fb22a675-d19b-43a4-81e8-acf29beee096 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:38.104826 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-fb22a675-d19b-43a4-81e8-acf29beee096 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:38.111184 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fb22a675-d19b-43a4-81e8-acf29beee096 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:38.111643 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fb22a675-d19b-43a4-81e8-acf29beee096 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:38.112423 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fb22a675-d19b-43a4-81e8-acf29beee096 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:38.112865 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fb22a675-d19b-43a4-81e8-acf29beee096 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:38.243552 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-fb22a675-d19b-43a4-81e8-acf29beee096 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:38.251028 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-fb22a675-d19b-43a4-81e8-acf29beee096 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1525 microversion: 2.1 time: 0.151420 Feb 16 14:26:38.251607 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 85/205] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:38 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1525 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:38.788670 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-646dd6ed-c1d2-4ded-a091-5d9f802e1f46 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:38.789278 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-646dd6ed-c1d2-4ded-a091-5d9f802e1f46 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:38.795086 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-646dd6ed-c1d2-4ded-a091-5d9f802e1f46 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:38.795534 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-646dd6ed-c1d2-4ded-a091-5d9f802e1f46 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:38.796318 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-646dd6ed-c1d2-4ded-a091-5d9f802e1f46 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:38.796747 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-646dd6ed-c1d2-4ded-a091-5d9f802e1f46 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:38.928705 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-646dd6ed-c1d2-4ded-a091-5d9f802e1f46 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd701d137d5744a3ea6b17a8568da17c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d38e42748249e495e0d4f675a018a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:38.937321 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-646dd6ed-c1d2-4ded-a091-5d9f802e1f46 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 200 len: 1557 microversion: 2.1 time: 0.152285 Feb 16 14:26:38.937886 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 121/206] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:38 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:26:39.267583 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-65373cb5-f3b4-46ef-bcee-69a5b17c9bd2 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:39.268112 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-65373cb5-f3b4-46ef-bcee-69a5b17c9bd2 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:39.274481 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-65373cb5-f3b4-46ef-bcee-69a5b17c9bd2 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:39.275616 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-65373cb5-f3b4-46ef-bcee-69a5b17c9bd2 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:39.276418 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-65373cb5-f3b4-46ef-bcee-69a5b17c9bd2 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:39.276855 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-65373cb5-f3b4-46ef-bcee-69a5b17c9bd2 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:39.420540 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-65373cb5-f3b4-46ef-bcee-69a5b17c9bd2 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:39.427925 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-65373cb5-f3b4-46ef-bcee-69a5b17c9bd2 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1525 microversion: 2.1 time: 0.164157 Feb 16 14:26:39.428501 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 86/207] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:39 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1525 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:39.953754 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-7d4f2472-b5aa-47f9-844c-b1c598ef65f4 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:39.954282 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-7d4f2472-b5aa-47f9-844c-b1c598ef65f4 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:39.960403 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7d4f2472-b5aa-47f9-844c-b1c598ef65f4 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:39.960841 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7d4f2472-b5aa-47f9-844c-b1c598ef65f4 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:39.961631 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7d4f2472-b5aa-47f9-844c-b1c598ef65f4 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:39.962055 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7d4f2472-b5aa-47f9-844c-b1c598ef65f4 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:40.094280 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-7d4f2472-b5aa-47f9-844c-b1c598ef65f4 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd701d137d5744a3ea6b17a8568da17c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d38e42748249e495e0d4f675a018a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:40.102229 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-7d4f2472-b5aa-47f9-844c-b1c598ef65f4 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 200 len: 1557 microversion: 2.1 time: 0.152245 Feb 16 14:26:40.102862 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 122/208] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:39 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:40.445054 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-656acecc-433a-4d91-927e-50fc64dab7b7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:40.445664 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-656acecc-433a-4d91-927e-50fc64dab7b7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:40.452486 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-656acecc-433a-4d91-927e-50fc64dab7b7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:40.452937 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-656acecc-433a-4d91-927e-50fc64dab7b7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:40.453717 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-656acecc-433a-4d91-927e-50fc64dab7b7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:40.454152 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-656acecc-433a-4d91-927e-50fc64dab7b7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:40.585703 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-656acecc-433a-4d91-927e-50fc64dab7b7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:40.594613 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-656acecc-433a-4d91-927e-50fc64dab7b7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1525 microversion: 2.1 time: 0.153169 Feb 16 14:26:40.595273 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 87/209] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:40 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1525 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:41.119788 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-b1c7c11f-45cd-4fd4-8b79-b21f016d3b17 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:41.120392 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-b1c7c11f-45cd-4fd4-8b79-b21f016d3b17 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:41.126520 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b1c7c11f-45cd-4fd4-8b79-b21f016d3b17 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:41.127004 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b1c7c11f-45cd-4fd4-8b79-b21f016d3b17 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:41.127784 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b1c7c11f-45cd-4fd4-8b79-b21f016d3b17 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:41.128216 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b1c7c11f-45cd-4fd4-8b79-b21f016d3b17 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:41.263907 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-b1c7c11f-45cd-4fd4-8b79-b21f016d3b17 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd701d137d5744a3ea6b17a8568da17c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d38e42748249e495e0d4f675a018a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:41.271938 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-b1c7c11f-45cd-4fd4-8b79-b21f016d3b17 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 200 len: 1557 microversion: 2.1 time: 0.156441 Feb 16 14:26:41.272566 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 123/210] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:41 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 1557 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:41.611566 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-4c7558dd-a74d-4bbd-854b-701119fc1798 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:41.612270 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-4c7558dd-a74d-4bbd-854b-701119fc1798 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:41.619092 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4c7558dd-a74d-4bbd-854b-701119fc1798 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:41.619555 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4c7558dd-a74d-4bbd-854b-701119fc1798 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:41.620360 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4c7558dd-a74d-4bbd-854b-701119fc1798 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:41.620834 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4c7558dd-a74d-4bbd-854b-701119fc1798 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:41.897748 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-4c7558dd-a74d-4bbd-854b-701119fc1798 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:41.905959 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-4c7558dd-a74d-4bbd-854b-701119fc1798 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1525 microversion: 2.1 time: 0.298078 Feb 16 14:26:41.906562 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 88/211] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:41 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1525 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:42.143661 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-68ae0b25-240f-413c-9dd7-c85ae3fcdf6d req-ed452acf-7f5a-4ea9-86a0-473f037391ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5", "name": "network-vif-deleted", "tag": "c1966fb6-188c-4fce-ae9a-a15dd7b2bc08"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:26:42.144188 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:26:42.144188 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:26:42.152179 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-68ae0b25-240f-413c-9dd7-c85ae3fcdf6d req-ed452acf-7f5a-4ea9-86a0-473f037391ea service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:42.152609 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-68ae0b25-240f-413c-9dd7-c85ae3fcdf6d req-ed452acf-7f5a-4ea9-86a0-473f037391ea service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:42.163661 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-68ae0b25-240f-413c-9dd7-c85ae3fcdf6d req-ed452acf-7f5a-4ea9-86a0-473f037391ea service nova] Creating event network-vif-deleted:c1966fb6-188c-4fce-ae9a-a15dd7b2bc08 for instance 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 on hv-cinder-80473 Feb 16 14:26:42.170117 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-68ae0b25-240f-413c-9dd7-c85ae3fcdf6d req-ed452acf-7f5a-4ea9-86a0-473f037391ea service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031282 Feb 16 14:26:42.170856 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 124/212] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 14:26:42.290185 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-64692cd1-91fe-40af-8f0e-f56124fd0985 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:42.291256 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-64692cd1-91fe-40af-8f0e-f56124fd0985 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:42.297398 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-64692cd1-91fe-40af-8f0e-f56124fd0985 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:42.297844 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-64692cd1-91fe-40af-8f0e-f56124fd0985 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:42.298650 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-64692cd1-91fe-40af-8f0e-f56124fd0985 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:42.299114 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-64692cd1-91fe-40af-8f0e-f56124fd0985 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:42.366431 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-64692cd1-91fe-40af-8f0e-f56124fd0985 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd701d137d5744a3ea6b17a8568da17c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d38e42748249e495e0d4f675a018a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:42.375141 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-64692cd1-91fe-40af-8f0e-f56124fd0985 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 200 len: 1350 microversion: 2.1 time: 0.089306 Feb 16 14:26:42.375722 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 89/213] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:42 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 1350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:42.923022 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-d2e3253e-6020-4c56-85e4-ea950a8027d1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:42.923712 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-d2e3253e-6020-4c56-85e4-ea950a8027d1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:42.930649 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d2e3253e-6020-4c56-85e4-ea950a8027d1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:42.931171 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d2e3253e-6020-4c56-85e4-ea950a8027d1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:42.932072 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d2e3253e-6020-4c56-85e4-ea950a8027d1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:42.932570 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d2e3253e-6020-4c56-85e4-ea950a8027d1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:43.076163 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-d2e3253e-6020-4c56-85e4-ea950a8027d1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:43.084511 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-d2e3253e-6020-4c56-85e4-ea950a8027d1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1525 microversion: 2.1 time: 0.165535 Feb 16 14:26:43.085308 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 125/214] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:42 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1525 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:43.392246 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-05d3d19f-23fa-43f2-89c3-977201aef575 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:43.393393 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-05d3d19f-23fa-43f2-89c3-977201aef575 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:43.400459 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-05d3d19f-23fa-43f2-89c3-977201aef575 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:43.400918 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-05d3d19f-23fa-43f2-89c3-977201aef575 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:43.401701 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-05d3d19f-23fa-43f2-89c3-977201aef575 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:43.402164 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-05d3d19f-23fa-43f2-89c3-977201aef575 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:43.452393 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-05d3d19f-23fa-43f2-89c3-977201aef575 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:43.452837 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-05d3d19f-23fa-43f2-89c3-977201aef575 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:43.453499 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-05d3d19f-23fa-43f2-89c3-977201aef575 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lazy-loading 'fault' on Instance uuid 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:26:43.507503 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-05d3d19f-23fa-43f2-89c3-977201aef575 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd701d137d5744a3ea6b17a8568da17c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04d38e42748249e495e0d4f675a018a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:43.519657 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-05d3d19f-23fa-43f2-89c3-977201aef575 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 200 len: 1355 microversion: 2.1 time: 0.131726 Feb 16 14:26:43.520718 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 90/215] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:43 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 1355 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:44.101182 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-29307c32-2b68-4ebe-b6d7-30716cf871a7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:44.101780 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-29307c32-2b68-4ebe-b6d7-30716cf871a7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:44.108322 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-29307c32-2b68-4ebe-b6d7-30716cf871a7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:44.108767 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-29307c32-2b68-4ebe-b6d7-30716cf871a7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:44.109542 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-29307c32-2b68-4ebe-b6d7-30716cf871a7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:44.109966 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-29307c32-2b68-4ebe-b6d7-30716cf871a7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:44.291907 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-29307c32-2b68-4ebe-b6d7-30716cf871a7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:44.299140 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-29307c32-2b68-4ebe-b6d7-30716cf871a7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1525 microversion: 2.1 time: 0.201833 Feb 16 14:26:44.299718 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 126/216] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:44 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1525 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:44.537313 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-fb8dd587-a724-458f-8869-8d6866884029 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:44.537940 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-fb8dd587-a724-458f-8869-8d6866884029 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:44.543930 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fb8dd587-a724-458f-8869-8d6866884029 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:44.544467 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fb8dd587-a724-458f-8869-8d6866884029 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:44.545342 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fb8dd587-a724-458f-8869-8d6866884029 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:44.545802 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fb8dd587-a724-458f-8869-8d6866884029 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:44.559704 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-fb8dd587-a724-458f-8869-8d6866884029 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] HTTP exception thrown: Instance 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 could not be found. Feb 16 14:26:44.560310 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-fb8dd587-a724-458f-8869-8d6866884029 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Returning 404 to user: Instance 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:26:44.561146 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-fb8dd587-a724-458f-8869-8d6866884029 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 404 len: 111 microversion: 2.1 time: 0.027865 Feb 16 14:26:44.561690 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 91/217] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:44 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 14:26:44.667881 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-cdfa1c87-fb09-41fb-bc3d-ba913ddb0bcb tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:44.669023 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-cdfa1c87-fb09-41fb-bc3d-ba913ddb0bcb tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:44.675209 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-cdfa1c87-fb09-41fb-bc3d-ba913ddb0bcb tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:44.675803 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-cdfa1c87-fb09-41fb-bc3d-ba913ddb0bcb tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:44.676756 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-cdfa1c87-fb09-41fb-bc3d-ba913ddb0bcb tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:44.677379 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-cdfa1c87-fb09-41fb-bc3d-ba913ddb0bcb tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:44.699466 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.wsgi [None req-cdfa1c87-fb09-41fb-bc3d-ba913ddb0bcb tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] HTTP exception thrown: Instance 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 could not be found. Feb 16 14:26:44.700073 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-cdfa1c87-fb09-41fb-bc3d-ba913ddb0bcb tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Returning 404 to user: Instance 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 could not be found. {{(pid=117031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:26:44.704548 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-cdfa1c87-fb09-41fb-bc3d-ba913ddb0bcb tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.039047 Feb 16 14:26:44.704548 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 127/218] 10.222.0.110 () {58 vars in 1306 bytes} [Wed Feb 16 14:26:44 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 14:26:45.315743 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-3f31c625-0e39-47bb-a854-fe54fd66c927 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:45.316368 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-3f31c625-0e39-47bb-a854-fe54fd66c927 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:45.322270 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3f31c625-0e39-47bb-a854-fe54fd66c927 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:45.322809 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3f31c625-0e39-47bb-a854-fe54fd66c927 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:45.323687 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3f31c625-0e39-47bb-a854-fe54fd66c927 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:45.324131 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3f31c625-0e39-47bb-a854-fe54fd66c927 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:45.462828 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3f31c625-0e39-47bb-a854-fe54fd66c927 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:45.471123 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-3f31c625-0e39-47bb-a854-fe54fd66c927 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1525 microversion: 2.1 time: 0.159211 Feb 16 14:26:45.471745 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 92/219] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:45 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1525 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:46.489474 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-0e285064-f278-41c1-a141-5086591ebf22 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:46.490720 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-0e285064-f278-41c1-a141-5086591ebf22 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:46.502908 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0e285064-f278-41c1-a141-5086591ebf22 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:46.503646 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0e285064-f278-41c1-a141-5086591ebf22 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:46.504636 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0e285064-f278-41c1-a141-5086591ebf22 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:46.505227 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0e285064-f278-41c1-a141-5086591ebf22 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:46.678147 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-0e285064-f278-41c1-a141-5086591ebf22 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:46.686274 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-0e285064-f278-41c1-a141-5086591ebf22 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1525 microversion: 2.1 time: 0.201011 Feb 16 14:26:46.686885 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 128/220] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:46 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1525 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:47.703202 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-39897627-992a-4243-a3f4-4b46c95d64b5 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:47.704418 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-39897627-992a-4243-a3f4-4b46c95d64b5 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:47.711724 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-39897627-992a-4243-a3f4-4b46c95d64b5 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:47.712383 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-39897627-992a-4243-a3f4-4b46c95d64b5 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:47.713763 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-39897627-992a-4243-a3f4-4b46c95d64b5 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:47.714549 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-39897627-992a-4243-a3f4-4b46c95d64b5 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:47.873029 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-39897627-992a-4243-a3f4-4b46c95d64b5 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:47.880419 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-39897627-992a-4243-a3f4-4b46c95d64b5 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1525 microversion: 2.1 time: 0.180986 Feb 16 14:26:47.880996 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 93/221] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:47 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1525 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:48.897805 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-8b3fcc24-525e-495a-b196-027ac57e0015 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:48.898451 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-8b3fcc24-525e-495a-b196-027ac57e0015 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:48.905075 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8b3fcc24-525e-495a-b196-027ac57e0015 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:48.905554 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8b3fcc24-525e-495a-b196-027ac57e0015 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:48.906330 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8b3fcc24-525e-495a-b196-027ac57e0015 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:48.906795 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8b3fcc24-525e-495a-b196-027ac57e0015 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:49.049074 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-8b3fcc24-525e-495a-b196-027ac57e0015 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:49.053944 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-8b3fcc24-525e-495a-b196-027ac57e0015 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1525 microversion: 2.1 time: 0.159512 Feb 16 14:26:49.054686 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 129/222] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:48 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1525 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:26:49.454018 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b2bf4174-1f5c-4273-b4c8-165bad8b68f9 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:49.454494 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b2bf4174-1f5c-4273-b4c8-165bad8b68f9 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:49.461089 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b2bf4174-1f5c-4273-b4c8-165bad8b68f9 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:49.462509 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b2bf4174-1f5c-4273-b4c8-165bad8b68f9 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:49.462509 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b2bf4174-1f5c-4273-b4c8-165bad8b68f9 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:49.462968 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b2bf4174-1f5c-4273-b4c8-165bad8b68f9 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:49.478858 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-b2bf4174-1f5c-4273-b4c8-165bad8b68f9 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] HTTP exception thrown: Instance 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 could not be found. Feb 16 14:26:49.479454 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b2bf4174-1f5c-4273-b4c8-165bad8b68f9 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Returning 404 to user: Instance 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:26:49.480387 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b2bf4174-1f5c-4273-b4c8-165bad8b68f9 tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "DELETE /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 404 len: 111 microversion: 2.1 time: 0.030366 Feb 16 14:26:49.480933 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 94/223] 10.222.0.110 () {58 vars in 1243 bytes} [Wed Feb 16 14:26:49 2022] DELETE /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 14:26:49.488800 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-3f96778f-bcfb-4d88-99b2-201e05adf45b tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:49.489690 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-3f96778f-bcfb-4d88-99b2-201e05adf45b tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] [instance: 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:49.501822 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3f96778f-bcfb-4d88-99b2-201e05adf45b tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:49.501822 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3f96778f-bcfb-4d88-99b2-201e05adf45b tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:49.501822 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3f96778f-bcfb-4d88-99b2-201e05adf45b tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:49.501822 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3f96778f-bcfb-4d88-99b2-201e05adf45b tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:49.514511 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.wsgi [None req-3f96778f-bcfb-4d88-99b2-201e05adf45b tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] HTTP exception thrown: Instance 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 could not be found. Feb 16 14:26:49.515289 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-3f96778f-bcfb-4d88-99b2-201e05adf45b tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] Returning 404 to user: Instance 99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 could not be found. {{(pid=117031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:26:49.516102 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-3f96778f-bcfb-4d88-99b2-201e05adf45b tempest-DeleteServersTestJSON-674257914 tempest-DeleteServersTestJSON-674257914-project] 10.222.0.110 "GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5" status: 404 len: 111 microversion: 2.1 time: 0.031020 Feb 16 14:26:49.516654 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 130/224] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:49 2022] GET /compute/v2.1/servers/99ac56cb-bc2c-4118-bfcc-1c83bd11a3c5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 16 14:26:50.071344 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-9e1a2ad9-2bdb-400e-a844-243f239b90e9 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:50.072308 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-9e1a2ad9-2bdb-400e-a844-243f239b90e9 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:50.082930 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9e1a2ad9-2bdb-400e-a844-243f239b90e9 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:50.083404 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9e1a2ad9-2bdb-400e-a844-243f239b90e9 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:50.091859 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9e1a2ad9-2bdb-400e-a844-243f239b90e9 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:50.092312 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9e1a2ad9-2bdb-400e-a844-243f239b90e9 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:50.321716 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-9e1a2ad9-2bdb-400e-a844-243f239b90e9 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:50.329846 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-9e1a2ad9-2bdb-400e-a844-243f239b90e9 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1525 microversion: 2.1 time: 0.262133 Feb 16 14:26:50.330428 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 95/225] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:50 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1525 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:26:51.347572 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-5ff790d0-43bd-41ea-a22f-aea876989e38 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:51.348902 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-5ff790d0-43bd-41ea-a22f-aea876989e38 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:51.356983 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5ff790d0-43bd-41ea-a22f-aea876989e38 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:51.356983 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5ff790d0-43bd-41ea-a22f-aea876989e38 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:51.356983 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5ff790d0-43bd-41ea-a22f-aea876989e38 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:51.356983 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5ff790d0-43bd-41ea-a22f-aea876989e38 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:51.521812 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-5ff790d0-43bd-41ea-a22f-aea876989e38 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:51.539288 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-5ff790d0-43bd-41ea-a22f-aea876989e38 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1525 microversion: 2.1 time: 0.187753 Feb 16 14:26:51.539971 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 131/226] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:51 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1525 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:52.560181 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f740905f-f9ed-42a4-9888-516e9c81b295 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:52.560806 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f740905f-f9ed-42a4-9888-516e9c81b295 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:52.569723 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f740905f-f9ed-42a4-9888-516e9c81b295 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:52.570169 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f740905f-f9ed-42a4-9888-516e9c81b295 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:52.570991 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f740905f-f9ed-42a4-9888-516e9c81b295 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:52.571423 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f740905f-f9ed-42a4-9888-516e9c81b295 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:52.735061 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f740905f-f9ed-42a4-9888-516e9c81b295 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:52.742788 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f740905f-f9ed-42a4-9888-516e9c81b295 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1525 microversion: 2.1 time: 0.190952 Feb 16 14:26:52.743371 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 96/227] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:52 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1525 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:53.760567 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-8249b9e1-7313-4ace-ab12-c588ac1d3797 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:53.761407 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-8249b9e1-7313-4ace-ab12-c588ac1d3797 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:53.767769 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8249b9e1-7313-4ace-ab12-c588ac1d3797 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:53.768313 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8249b9e1-7313-4ace-ab12-c588ac1d3797 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:53.769209 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8249b9e1-7313-4ace-ab12-c588ac1d3797 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:53.769716 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8249b9e1-7313-4ace-ab12-c588ac1d3797 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:53.920088 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-8249b9e1-7313-4ace-ab12-c588ac1d3797 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:53.927627 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-8249b9e1-7313-4ace-ab12-c588ac1d3797 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1525 microversion: 2.1 time: 0.171510 Feb 16 14:26:53.928375 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 132/228] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:53 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1525 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:54.944385 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-3b30b278-e704-48da-b5bd-4e01455c7b8e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:54.945045 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-3b30b278-e704-48da-b5bd-4e01455c7b8e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:54.955322 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3b30b278-e704-48da-b5bd-4e01455c7b8e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:54.955322 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3b30b278-e704-48da-b5bd-4e01455c7b8e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:54.955322 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3b30b278-e704-48da-b5bd-4e01455c7b8e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:54.955322 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3b30b278-e704-48da-b5bd-4e01455c7b8e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:55.110513 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3b30b278-e704-48da-b5bd-4e01455c7b8e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:55.118995 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-3b30b278-e704-48da-b5bd-4e01455c7b8e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1525 microversion: 2.1 time: 0.178122 Feb 16 14:26:55.119688 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 97/229] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:54 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1525 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:56.142165 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-7b8a8346-151f-446b-9dd4-649de6452ad7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:56.143351 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-7b8a8346-151f-446b-9dd4-649de6452ad7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:56.152958 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7b8a8346-151f-446b-9dd4-649de6452ad7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:56.153371 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7b8a8346-151f-446b-9dd4-649de6452ad7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:56.154170 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7b8a8346-151f-446b-9dd4-649de6452ad7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:56.154731 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7b8a8346-151f-446b-9dd4-649de6452ad7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:56.331722 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-7b8a8346-151f-446b-9dd4-649de6452ad7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:56.344475 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-7b8a8346-151f-446b-9dd4-649de6452ad7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1525 microversion: 2.1 time: 0.205700 Feb 16 14:26:56.345516 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 133/230] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:56 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1525 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:57.364519 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c20d3e35-204c-4946-ac90-40591a0d798b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:57.365751 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c20d3e35-204c-4946-ac90-40591a0d798b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:57.375536 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c20d3e35-204c-4946-ac90-40591a0d798b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:57.376142 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c20d3e35-204c-4946-ac90-40591a0d798b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:57.376972 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c20d3e35-204c-4946-ac90-40591a0d798b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:57.377401 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c20d3e35-204c-4946-ac90-40591a0d798b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:57.564289 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c20d3e35-204c-4946-ac90-40591a0d798b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:57.571738 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c20d3e35-204c-4946-ac90-40591a0d798b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1525 microversion: 2.1 time: 0.211659 Feb 16 14:26:57.574670 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 98/231] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:57 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1525 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:58.588852 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-108e5842-9fb2-4f53-93fd-66fc8240b7ac tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:58.589452 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-108e5842-9fb2-4f53-93fd-66fc8240b7ac tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:58.595348 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-108e5842-9fb2-4f53-93fd-66fc8240b7ac tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:58.595795 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-108e5842-9fb2-4f53-93fd-66fc8240b7ac tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:58.596570 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-108e5842-9fb2-4f53-93fd-66fc8240b7ac tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:58.597001 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-108e5842-9fb2-4f53-93fd-66fc8240b7ac tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:58.931438 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-108e5842-9fb2-4f53-93fd-66fc8240b7ac tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:26:58.939243 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-108e5842-9fb2-4f53-93fd-66fc8240b7ac tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1525 microversion: 2.1 time: 0.354343 Feb 16 14:26:58.939808 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 134/232] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:58 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1525 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:26:59.956505 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-943c049a-b434-4de4-8022-b4a839207339 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:26:59.957150 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-943c049a-b434-4de4-8022-b4a839207339 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:26:59.964109 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-943c049a-b434-4de4-8022-b4a839207339 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:59.964560 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-943c049a-b434-4de4-8022-b4a839207339 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:26:59.965344 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-943c049a-b434-4de4-8022-b4a839207339 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:26:59.965780 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-943c049a-b434-4de4-8022-b4a839207339 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:00.106224 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-943c049a-b434-4de4-8022-b4a839207339 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:00.113574 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-943c049a-b434-4de4-8022-b4a839207339 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1525 microversion: 2.1 time: 0.160980 Feb 16 14:27:00.114142 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 99/233] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:26:59 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1525 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:01.129916 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-c2b3c099-e737-41d4-b1a9-aa4684932d35 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:01.130528 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-c2b3c099-e737-41d4-b1a9-aa4684932d35 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:01.136757 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c2b3c099-e737-41d4-b1a9-aa4684932d35 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:01.140644 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c2b3c099-e737-41d4-b1a9-aa4684932d35 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:01.140644 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c2b3c099-e737-41d4-b1a9-aa4684932d35 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:01.140644 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c2b3c099-e737-41d4-b1a9-aa4684932d35 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:01.298428 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-c2b3c099-e737-41d4-b1a9-aa4684932d35 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:01.302559 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-c2b3c099-e737-41d4-b1a9-aa4684932d35 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1525 microversion: 2.1 time: 0.176300 Feb 16 14:27:01.303308 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 135/234] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:01 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1525 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:02.319318 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e5408e1b-1a9c-411f-b2f3-af3bcc04b1c6 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:02.319943 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-e5408e1b-1a9c-411f-b2f3-af3bcc04b1c6 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:02.327775 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e5408e1b-1a9c-411f-b2f3-af3bcc04b1c6 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:02.328286 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e5408e1b-1a9c-411f-b2f3-af3bcc04b1c6 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:02.330276 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e5408e1b-1a9c-411f-b2f3-af3bcc04b1c6 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:02.330741 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e5408e1b-1a9c-411f-b2f3-af3bcc04b1c6 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:02.467055 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-e5408e1b-1a9c-411f-b2f3-af3bcc04b1c6 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:02.474491 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-e5408e1b-1a9c-411f-b2f3-af3bcc04b1c6 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1505 microversion: 2.1 time: 0.158796 Feb 16 14:27:02.475098 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 100/235] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:02 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:02.490514 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-57118403-4260-4b18-b829-1d0c3163151b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:02.491162 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-57118403-4260-4b18-b829-1d0c3163151b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:02.499145 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-57118403-4260-4b18-b829-1d0c3163151b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:02.501417 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-57118403-4260-4b18-b829-1d0c3163151b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:02.501417 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-57118403-4260-4b18-b829-1d0c3163151b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:02.501417 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-57118403-4260-4b18-b829-1d0c3163151b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:02.638926 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-57118403-4260-4b18-b829-1d0c3163151b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:02.646182 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-57118403-4260-4b18-b829-1d0c3163151b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1519 microversion: 2.1 time: 0.159367 Feb 16 14:27:02.646791 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 136/236] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:02 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:05.574718 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-62dfc56c-3a50-42e1-9d76-5b2eaa36e282 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:27:05.575678 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-62dfc56c-3a50-42e1-9d76-5b2eaa36e282 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:05.582299 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-62dfc56c-3a50-42e1-9d76-5b2eaa36e282 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:05.583684 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-62dfc56c-3a50-42e1-9d76-5b2eaa36e282 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:05.583684 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-62dfc56c-3a50-42e1-9d76-5b2eaa36e282 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:05.584237 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-62dfc56c-3a50-42e1-9d76-5b2eaa36e282 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:05.610270 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-62dfc56c-3a50-42e1-9d76-5b2eaa36e282 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lazy-loading 'flavor' on Instance uuid 05accb7b-6275-4c8e-a18b-69b67bdc1d8d {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:27:05.989024 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-62dfc56c-3a50-42e1-9d76-5b2eaa36e282 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "POST /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d/action" status: 200 len: 32 microversion: 2.1 time: 0.418220 Feb 16 14:27:05.989644 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 101/237] 10.222.0.110 () {60 vars in 1282 bytes} [Wed Feb 16 14:27:05 2022] POST /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d/action => generated 32 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 16 14:27:05.999774 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-3ff4ccd1-123f-4cb2-9946-297b9cfec82b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:06.001110 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-3ff4ccd1-123f-4cb2-9946-297b9cfec82b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:06.007716 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3ff4ccd1-123f-4cb2-9946-297b9cfec82b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:06.009050 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3ff4ccd1-123f-4cb2-9946-297b9cfec82b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:06.010129 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3ff4ccd1-123f-4cb2-9946-297b9cfec82b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:06.010794 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3ff4ccd1-123f-4cb2-9946-297b9cfec82b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:06.354407 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-3ff4ccd1-123f-4cb2-9946-297b9cfec82b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:06.369310 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-3ff4ccd1-123f-4cb2-9946-297b9cfec82b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1525 microversion: 2.1 time: 0.373282 Feb 16 14:27:06.370763 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 137/238] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:05 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1525 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:07.398102 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-77d0ce1b-269d-470f-8ea3-bf34146c38da tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:07.398102 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-77d0ce1b-269d-470f-8ea3-bf34146c38da tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:07.402529 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-77d0ce1b-269d-470f-8ea3-bf34146c38da tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:07.403368 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-77d0ce1b-269d-470f-8ea3-bf34146c38da tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:07.404220 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-77d0ce1b-269d-470f-8ea3-bf34146c38da tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:07.404668 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-77d0ce1b-269d-470f-8ea3-bf34146c38da tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:07.577781 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-77d0ce1b-269d-470f-8ea3-bf34146c38da tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:07.585421 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-77d0ce1b-269d-470f-8ea3-bf34146c38da tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1525 microversion: 2.1 time: 0.195564 Feb 16 14:27:07.586060 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 102/239] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:07 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1525 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:08.606505 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-dc61ced3-3aec-4bc3-8ee6-ac3ccde22ad3 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:08.607207 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-dc61ced3-3aec-4bc3-8ee6-ac3ccde22ad3 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:08.615104 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-dc61ced3-3aec-4bc3-8ee6-ac3ccde22ad3 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:08.622645 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-dc61ced3-3aec-4bc3-8ee6-ac3ccde22ad3 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:08.623707 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-dc61ced3-3aec-4bc3-8ee6-ac3ccde22ad3 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:08.624626 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-dc61ced3-3aec-4bc3-8ee6-ac3ccde22ad3 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:08.786137 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-dc61ced3-3aec-4bc3-8ee6-ac3ccde22ad3 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:08.794234 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-dc61ced3-3aec-4bc3-8ee6-ac3ccde22ad3 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1525 microversion: 2.1 time: 0.192536 Feb 16 14:27:08.794837 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 138/240] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:08 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1525 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:09.411547 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f95a597a-15b4-433a-938c-bcd90ef84e74 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1669966698", "imageRef": "2493d2dc-e081-43d3-8292-91b4762a21e8", "flavorRef": "452", "networks": [{"uuid": "020f3991-eae7-469b-87bf-c0a4566703d8"}]}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:27:09.470499 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.network.neutron [None req-f95a597a-15b4-433a-938c-bcd90ef84e74 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] validate_networks() for [('020f3991-eae7-469b-87bf-c0a4566703d8', None, None, None, None, None)] {{(pid=117032) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 16 14:27:09.813003 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-b3e62a25-6ae3-4e85-8096-b2aa9196ebfb tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:09.813883 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-b3e62a25-6ae3-4e85-8096-b2aa9196ebfb tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:09.824763 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b3e62a25-6ae3-4e85-8096-b2aa9196ebfb tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:09.825371 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b3e62a25-6ae3-4e85-8096-b2aa9196ebfb tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:09.826668 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b3e62a25-6ae3-4e85-8096-b2aa9196ebfb tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:09.827579 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b3e62a25-6ae3-4e85-8096-b2aa9196ebfb tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:09.848394 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-f95a597a-15b4-433a-938c-bcd90ef84e74 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Flavor limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 16 14:27:09.848986 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-f95a597a-15b4-433a-938c-bcd90ef84e74 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Image limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 16 14:27:09.849695 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-f95a597a-15b4-433a-938c-bcd90ef84e74 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Flavor pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 16 14:27:09.850337 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-f95a597a-15b4-433a-938c-bcd90ef84e74 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Image pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 16 14:27:09.850825 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-f95a597a-15b4-433a-938c-bcd90ef84e74 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 16 14:27:09.860743 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f95a597a-15b4-433a-938c-bcd90ef84e74 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:09.861405 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f95a597a-15b4-433a-938c-bcd90ef84e74 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:09.862259 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f95a597a-15b4-433a-938c-bcd90ef84e74 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:09.862791 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f95a597a-15b4-433a-938c-bcd90ef84e74 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:09.880823 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-f95a597a-15b4-433a-938c-bcd90ef84e74 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Getting quotas for project f6c24eb6d16648b4a04462f208612157. Resources: {'cores', 'instances', 'ram'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 14:27:09.885260 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-f95a597a-15b4-433a-938c-bcd90ef84e74 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Getting quotas for user 607d12050d20401e9850ab64c57b8c04 and project f6c24eb6d16648b4a04462f208612157. Resources: {'cores', 'instances', 'ram'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 14:27:09.896997 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f95a597a-15b4-433a-938c-bcd90ef84e74 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Going to run 1 instances... {{(pid=117032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 16 14:27:09.899378 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f95a597a-15b4-433a-938c-bcd90ef84e74 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: d86c93ea-a9ad-4b0c-bc25-18f3da5bb813] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2493d2dc-e081-43d3-8292-91b4762a21e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 16 14:27:09.973785 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-b3e62a25-6ae3-4e85-8096-b2aa9196ebfb tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:09.981530 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-b3e62a25-6ae3-4e85-8096-b2aa9196ebfb tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1525 microversion: 2.1 time: 0.173467 Feb 16 14:27:09.982109 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 139/241] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:09 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1525 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:10.047915 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f95a597a-15b4-433a-938c-bcd90ef84e74 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.640087 Feb 16 14:27:10.048572 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 103/242] 10.222.0.110 () {60 vars in 1151 bytes} [Wed Feb 16 14:27:09 2022] POST /compute/v2.1/servers => generated 382 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Feb 16 14:27:10.059600 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-b40fe184-530c-4303-b707-7eab9c7ad6ea tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:10.060217 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-b40fe184-530c-4303-b707-7eab9c7ad6ea tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: d86c93ea-a9ad-4b0c-bc25-18f3da5bb813] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:10.131168 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-b40fe184-530c-4303-b707-7eab9c7ad6ea tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:10.139353 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-b40fe184-530c-4303-b707-7eab9c7ad6ea tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813" status: 200 len: 1223 microversion: 2.1 time: 0.084520 Feb 16 14:27:10.140033 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 140/243] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:10 2022] GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:10.998426 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e2aa5257-4858-4c3c-ba36-b938b032d368 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:11.002830 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-e2aa5257-4858-4c3c-ba36-b938b032d368 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:11.005611 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e2aa5257-4858-4c3c-ba36-b938b032d368 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:11.006068 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e2aa5257-4858-4c3c-ba36-b938b032d368 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:11.006883 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e2aa5257-4858-4c3c-ba36-b938b032d368 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:11.007324 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e2aa5257-4858-4c3c-ba36-b938b032d368 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:11.146025 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-e2aa5257-4858-4c3c-ba36-b938b032d368 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:11.154289 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-e2aa5257-4858-4c3c-ba36-b938b032d368 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1525 microversion: 2.1 time: 0.160600 Feb 16 14:27:11.154888 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 104/244] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:10 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1525 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:11.156729 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-2e12d7d0-051b-44c3-a8e0-b1cc7d9f001f tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:11.157762 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-2e12d7d0-051b-44c3-a8e0-b1cc7d9f001f tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: d86c93ea-a9ad-4b0c-bc25-18f3da5bb813] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:11.208444 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-2e12d7d0-051b-44c3-a8e0-b1cc7d9f001f tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:11.216243 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-2e12d7d0-051b-44c3-a8e0-b1cc7d9f001f tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813" status: 200 len: 1223 microversion: 2.1 time: 0.063306 Feb 16 14:27:11.216794 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 141/245] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:11 2022] GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813 => generated 1223 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:27:12.171634 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ead1674f-cb1a-4429-89f2-58e4f2af65a0 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:12.172241 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ead1674f-cb1a-4429-89f2-58e4f2af65a0 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:12.178610 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ead1674f-cb1a-4429-89f2-58e4f2af65a0 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:12.179115 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ead1674f-cb1a-4429-89f2-58e4f2af65a0 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:12.179887 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ead1674f-cb1a-4429-89f2-58e4f2af65a0 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:12.180318 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ead1674f-cb1a-4429-89f2-58e4f2af65a0 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:12.233468 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-c93ffb3a-1877-4677-9a7b-6e24bb8fd4b7 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:12.234073 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-c93ffb3a-1877-4677-9a7b-6e24bb8fd4b7 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: d86c93ea-a9ad-4b0c-bc25-18f3da5bb813] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:12.240954 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c93ffb3a-1877-4677-9a7b-6e24bb8fd4b7 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:12.241481 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c93ffb3a-1877-4677-9a7b-6e24bb8fd4b7 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:12.242288 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c93ffb3a-1877-4677-9a7b-6e24bb8fd4b7 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:12.242751 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c93ffb3a-1877-4677-9a7b-6e24bb8fd4b7 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:12.345210 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-c93ffb3a-1877-4677-9a7b-6e24bb8fd4b7 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:12.348537 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ead1674f-cb1a-4429-89f2-58e4f2af65a0 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:12.352899 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-c93ffb3a-1877-4677-9a7b-6e24bb8fd4b7 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813" status: 200 len: 1275 microversion: 2.1 time: 0.123996 Feb 16 14:27:12.356601 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 142/246] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:12 2022] GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813 => generated 1275 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:12.358832 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ead1674f-cb1a-4429-89f2-58e4f2af65a0 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1525 microversion: 2.1 time: 0.190180 Feb 16 14:27:12.358832 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 105/247] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:12 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1525 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:13.375714 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-5fcec50c-dc0b-4376-a27e-70a4c76b4b9e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:13.376331 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-5fcec50c-dc0b-4376-a27e-70a4c76b4b9e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:13.376618 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f792a833-f4f6-4684-9215-e2f912be8c6d tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:13.377256 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f792a833-f4f6-4684-9215-e2f912be8c6d tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: d86c93ea-a9ad-4b0c-bc25-18f3da5bb813] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:13.384484 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5fcec50c-dc0b-4376-a27e-70a4c76b4b9e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:13.385193 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5fcec50c-dc0b-4376-a27e-70a4c76b4b9e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:13.391634 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5fcec50c-dc0b-4376-a27e-70a4c76b4b9e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:13.391634 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5fcec50c-dc0b-4376-a27e-70a4c76b4b9e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:13.391843 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f792a833-f4f6-4684-9215-e2f912be8c6d tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:13.391843 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f792a833-f4f6-4684-9215-e2f912be8c6d tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:13.391843 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f792a833-f4f6-4684-9215-e2f912be8c6d tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:13.391843 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f792a833-f4f6-4684-9215-e2f912be8c6d tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:13.504571 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f792a833-f4f6-4684-9215-e2f912be8c6d tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:13.512354 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f792a833-f4f6-4684-9215-e2f912be8c6d tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813" status: 200 len: 1281 microversion: 2.1 time: 0.141663 Feb 16 14:27:13.512935 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 106/248] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:13 2022] GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813 => generated 1281 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:27:13.537010 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-5fcec50c-dc0b-4376-a27e-70a4c76b4b9e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:13.545096 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-5fcec50c-dc0b-4376-a27e-70a4c76b4b9e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1525 microversion: 2.1 time: 0.175341 Feb 16 14:27:13.545761 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 143/249] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:13 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1525 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:14.528853 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-5f1ffc02-d5ca-4b97-b58c-efd2ccd44cce tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:14.529494 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-5f1ffc02-d5ca-4b97-b58c-efd2ccd44cce tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: d86c93ea-a9ad-4b0c-bc25-18f3da5bb813] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:14.535468 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5f1ffc02-d5ca-4b97-b58c-efd2ccd44cce tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:14.535918 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5f1ffc02-d5ca-4b97-b58c-efd2ccd44cce tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:14.536698 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5f1ffc02-d5ca-4b97-b58c-efd2ccd44cce tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:14.537307 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5f1ffc02-d5ca-4b97-b58c-efd2ccd44cce tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:14.562259 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-3b192a3f-5661-4027-87fe-ae8fe6b7d53b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:14.563592 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-3b192a3f-5661-4027-87fe-ae8fe6b7d53b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:14.570606 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3b192a3f-5661-4027-87fe-ae8fe6b7d53b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:14.571220 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3b192a3f-5661-4027-87fe-ae8fe6b7d53b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:14.572908 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3b192a3f-5661-4027-87fe-ae8fe6b7d53b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:14.574754 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3b192a3f-5661-4027-87fe-ae8fe6b7d53b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:14.847656 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-3b192a3f-5661-4027-87fe-ae8fe6b7d53b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:14.869784 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-3b192a3f-5661-4027-87fe-ae8fe6b7d53b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1525 microversion: 2.1 time: 0.299696 Feb 16 14:27:14.869784 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 144/250] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:14 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1525 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:27:14.994544 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-5f1ffc02-d5ca-4b97-b58c-efd2ccd44cce tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:15.002388 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-5f1ffc02-d5ca-4b97-b58c-efd2ccd44cce tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813" status: 200 len: 1323 microversion: 2.1 time: 0.477895 Feb 16 14:27:15.002997 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 107/251] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:14 2022] GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813 => generated 1323 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:15.035533 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-b67ee3f1-2c81-4296-86f6-7171c2004453 req-1fb0f78f-5f61-4cf4-8b99-1ed04f76d11b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d86c93ea-a9ad-4b0c-bc25-18f3da5bb813", "tag": "0bb1f89d-e659-4b77-826a-fe2b1eebc599"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:27:15.037744 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:27:15.037744 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:27:15.047350 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-b67ee3f1-2c81-4296-86f6-7171c2004453 req-1fb0f78f-5f61-4cf4-8b99-1ed04f76d11b service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:15.047966 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-b67ee3f1-2c81-4296-86f6-7171c2004453 req-1fb0f78f-5f61-4cf4-8b99-1ed04f76d11b service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:15.059160 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-b67ee3f1-2c81-4296-86f6-7171c2004453 req-1fb0f78f-5f61-4cf4-8b99-1ed04f76d11b service nova] Creating event network-changed:0bb1f89d-e659-4b77-826a-fe2b1eebc599 for instance d86c93ea-a9ad-4b0c-bc25-18f3da5bb813 on hv-cinder-80473 Feb 16 14:27:15.064958 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-b67ee3f1-2c81-4296-86f6-7171c2004453 req-1fb0f78f-5f61-4cf4-8b99-1ed04f76d11b service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032891 Feb 16 14:27:15.066109 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 145/252] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:27:15.884850 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b433f6ef-0887-4709-a133-95f05e20145f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:15.885466 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b433f6ef-0887-4709-a133-95f05e20145f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:15.892694 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b433f6ef-0887-4709-a133-95f05e20145f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:15.893207 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b433f6ef-0887-4709-a133-95f05e20145f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:15.894096 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b433f6ef-0887-4709-a133-95f05e20145f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:15.894544 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b433f6ef-0887-4709-a133-95f05e20145f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:16.020208 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-a7a83da0-d401-4ce1-9840-a42092cee7f5 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:16.021688 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-a7a83da0-d401-4ce1-9840-a42092cee7f5 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: d86c93ea-a9ad-4b0c-bc25-18f3da5bb813] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:16.028644 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a7a83da0-d401-4ce1-9840-a42092cee7f5 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:16.029376 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a7a83da0-d401-4ce1-9840-a42092cee7f5 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:16.030639 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a7a83da0-d401-4ce1-9840-a42092cee7f5 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:16.031346 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a7a83da0-d401-4ce1-9840-a42092cee7f5 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:16.044402 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b433f6ef-0887-4709-a133-95f05e20145f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:16.053657 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b433f6ef-0887-4709-a133-95f05e20145f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1525 microversion: 2.1 time: 0.172392 Feb 16 14:27:16.054561 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 108/253] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:15 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1525 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:16.221587 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-a7a83da0-d401-4ce1-9840-a42092cee7f5 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:16.228939 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-a7a83da0-d401-4ce1-9840-a42092cee7f5 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813" status: 200 len: 1323 microversion: 2.1 time: 0.213112 Feb 16 14:27:16.229505 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 146/254] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:16 2022] GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813 => generated 1323 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:17.070540 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-75a0e5fa-1a77-44a1-916f-b749cd4fae84 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:17.071219 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-75a0e5fa-1a77-44a1-916f-b749cd4fae84 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:17.078105 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-75a0e5fa-1a77-44a1-916f-b749cd4fae84 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:17.078558 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-75a0e5fa-1a77-44a1-916f-b749cd4fae84 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:17.079656 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-75a0e5fa-1a77-44a1-916f-b749cd4fae84 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:17.080091 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-75a0e5fa-1a77-44a1-916f-b749cd4fae84 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:17.247654 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-b52251e8-f367-4c7e-87b1-24456698e2cf tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:17.250257 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-b52251e8-f367-4c7e-87b1-24456698e2cf tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: d86c93ea-a9ad-4b0c-bc25-18f3da5bb813] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:17.256438 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b52251e8-f367-4c7e-87b1-24456698e2cf tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:17.257124 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b52251e8-f367-4c7e-87b1-24456698e2cf tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:17.258071 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b52251e8-f367-4c7e-87b1-24456698e2cf tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:17.258739 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b52251e8-f367-4c7e-87b1-24456698e2cf tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:17.352155 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-75a0e5fa-1a77-44a1-916f-b749cd4fae84 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:17.360981 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-75a0e5fa-1a77-44a1-916f-b749cd4fae84 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1525 microversion: 2.1 time: 0.294854 Feb 16 14:27:17.367167 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 109/255] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:17 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1525 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:17.427678 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-b52251e8-f367-4c7e-87b1-24456698e2cf tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:17.435817 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-b52251e8-f367-4c7e-87b1-24456698e2cf tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813" status: 200 len: 1323 microversion: 2.1 time: 0.193703 Feb 16 14:27:17.436530 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 147/256] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:17 2022] GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813 => generated 1323 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:27:18.377977 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-eb4d606e-e691-4b98-99df-9c583cfe1b92 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:18.378587 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-eb4d606e-e691-4b98-99df-9c583cfe1b92 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:18.385184 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-eb4d606e-e691-4b98-99df-9c583cfe1b92 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:18.385636 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-eb4d606e-e691-4b98-99df-9c583cfe1b92 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:18.387144 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-eb4d606e-e691-4b98-99df-9c583cfe1b92 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:18.387606 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-eb4d606e-e691-4b98-99df-9c583cfe1b92 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:18.455009 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-9c58b64f-474d-4f15-8579-b3b9e7ef8817 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:18.456278 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-9c58b64f-474d-4f15-8579-b3b9e7ef8817 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: d86c93ea-a9ad-4b0c-bc25-18f3da5bb813] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:18.462444 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9c58b64f-474d-4f15-8579-b3b9e7ef8817 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:18.463177 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9c58b64f-474d-4f15-8579-b3b9e7ef8817 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:18.465600 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9c58b64f-474d-4f15-8579-b3b9e7ef8817 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:18.466247 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9c58b64f-474d-4f15-8579-b3b9e7ef8817 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:18.666479 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-eb4d606e-e691-4b98-99df-9c583cfe1b92 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:18.687905 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-eb4d606e-e691-4b98-99df-9c583cfe1b92 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1525 microversion: 2.1 time: 0.311002 Feb 16 14:27:18.693057 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 110/257] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:18 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1525 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:18.708734 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-9c58b64f-474d-4f15-8579-b3b9e7ef8817 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:18.719954 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-9c58b64f-474d-4f15-8579-b3b9e7ef8817 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813" status: 200 len: 1323 microversion: 2.1 time: 0.270576 Feb 16 14:27:18.721207 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 148/258] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:18 2022] GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813 => generated 1323 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:19.708353 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-83f14794-b57c-4365-b580-4de4513b698b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:19.714820 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-83f14794-b57c-4365-b580-4de4513b698b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:19.718289 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-83f14794-b57c-4365-b580-4de4513b698b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:19.718787 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-83f14794-b57c-4365-b580-4de4513b698b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:19.719666 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-83f14794-b57c-4365-b580-4de4513b698b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:19.720072 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-83f14794-b57c-4365-b580-4de4513b698b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:19.738047 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-ad8be0af-af1f-4bbf-addf-f17f8f42121e tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:19.738884 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-ad8be0af-af1f-4bbf-addf-f17f8f42121e tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: d86c93ea-a9ad-4b0c-bc25-18f3da5bb813] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:19.746944 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ad8be0af-af1f-4bbf-addf-f17f8f42121e tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:19.749653 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ad8be0af-af1f-4bbf-addf-f17f8f42121e tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:19.749653 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ad8be0af-af1f-4bbf-addf-f17f8f42121e tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:19.749653 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ad8be0af-af1f-4bbf-addf-f17f8f42121e tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:19.897019 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-83f14794-b57c-4365-b580-4de4513b698b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:19.909729 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-83f14794-b57c-4365-b580-4de4513b698b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1525 microversion: 2.1 time: 0.204235 Feb 16 14:27:19.922316 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 111/259] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:19 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1525 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:19.938289 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-ad8be0af-af1f-4bbf-addf-f17f8f42121e tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:19.946855 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-ad8be0af-af1f-4bbf-addf-f17f8f42121e tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813" status: 200 len: 1323 microversion: 2.1 time: 0.213178 Feb 16 14:27:19.947436 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 149/260] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:19 2022] GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813 => generated 1323 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:27:20.802088 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-63bf9e1e-a15f-4e75-ab8f-a3e60adaf5fb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:27:20.803098 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-63bf9e1e-a15f-4e75-ab8f-a3e60adaf5fb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:20.809363 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-63bf9e1e-a15f-4e75-ab8f-a3e60adaf5fb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:20.809806 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-63bf9e1e-a15f-4e75-ab8f-a3e60adaf5fb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:20.810580 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-63bf9e1e-a15f-4e75-ab8f-a3e60adaf5fb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:20.811044 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-63bf9e1e-a15f-4e75-ab8f-a3e60adaf5fb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:20.836931 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-63bf9e1e-a15f-4e75-ab8f-a3e60adaf5fb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lazy-loading 'flavor' on Instance uuid e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:27:20.929105 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-4194c922-0bfa-4466-87ad-1a7767be8bb0 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:20.936599 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-4194c922-0bfa-4466-87ad-1a7767be8bb0 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:20.936599 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4194c922-0bfa-4466-87ad-1a7767be8bb0 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:20.936977 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4194c922-0bfa-4466-87ad-1a7767be8bb0 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:20.937893 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4194c922-0bfa-4466-87ad-1a7767be8bb0 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:20.938398 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4194c922-0bfa-4466-87ad-1a7767be8bb0 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:21.068970 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-4194c922-0bfa-4466-87ad-1a7767be8bb0 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:21.076376 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-4194c922-0bfa-4466-87ad-1a7767be8bb0 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1525 microversion: 2.1 time: 0.151026 Feb 16 14:27:21.076941 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 150/261] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:20 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1525 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:27:21.081323 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-007a2097-c769-458d-b951-1660d73b2119 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:21.081916 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-007a2097-c769-458d-b951-1660d73b2119 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: d86c93ea-a9ad-4b0c-bc25-18f3da5bb813] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:21.087596 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-007a2097-c769-458d-b951-1660d73b2119 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:21.088039 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-007a2097-c769-458d-b951-1660d73b2119 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:21.088817 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-007a2097-c769-458d-b951-1660d73b2119 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:21.089389 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-007a2097-c769-458d-b951-1660d73b2119 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:21.244839 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-007a2097-c769-458d-b951-1660d73b2119 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:21.264841 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-007a2097-c769-458d-b951-1660d73b2119 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813" status: 200 len: 1323 microversion: 2.1 time: 0.186681 Feb 16 14:27:21.280313 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 151/262] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:21 2022] GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813 => generated 1323 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:21.449964 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-63bf9e1e-a15f-4e75-ab8f-a3e60adaf5fb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "POST /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9/action" status: 202 len: 0 microversion: 2.20 time: 0.651506 Feb 16 14:27:21.450682 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 112/263] 10.222.0.110 () {62 vars in 1323 bytes} [Wed Feb 16 14:27:20 2022] POST /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9/action => generated 0 bytes in 653 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 16 14:27:21.458864 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-4f2e88e4-6513-417c-9b7b-ca72078c5e10 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:21.459661 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-4f2e88e4-6513-417c-9b7b-ca72078c5e10 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:21.466166 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4f2e88e4-6513-417c-9b7b-ca72078c5e10 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:21.466610 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4f2e88e4-6513-417c-9b7b-ca72078c5e10 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:21.467417 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4f2e88e4-6513-417c-9b7b-ca72078c5e10 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:21.467849 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4f2e88e4-6513-417c-9b7b-ca72078c5e10 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:21.603564 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-4f2e88e4-6513-417c-9b7b-ca72078c5e10 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:21.612090 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-4f2e88e4-6513-417c-9b7b-ca72078c5e10 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:21.613656 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-4f2e88e4-6513-417c-9b7b-ca72078c5e10 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:21.614908 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-4f2e88e4-6513-417c-9b7b-ca72078c5e10 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1727 microversion: 2.20 time: 0.159695 Feb 16 14:27:21.616037 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 152/264] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:27:21 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:27:22.094804 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-8602b450-4fc7-4657-aacb-e81ab97a3d1e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:22.095507 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-8602b450-4fc7-4657-aacb-e81ab97a3d1e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:22.101735 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8602b450-4fc7-4657-aacb-e81ab97a3d1e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:22.102186 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8602b450-4fc7-4657-aacb-e81ab97a3d1e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:22.102997 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8602b450-4fc7-4657-aacb-e81ab97a3d1e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:22.103433 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8602b450-4fc7-4657-aacb-e81ab97a3d1e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:22.257228 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-8602b450-4fc7-4657-aacb-e81ab97a3d1e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:22.262246 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-8602b450-4fc7-4657-aacb-e81ab97a3d1e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1525 microversion: 2.1 time: 0.171923 Feb 16 14:27:22.262863 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 113/265] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:22 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1525 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:22.286057 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-22effce7-a8d4-40f2-ba8d-34b9657540ed tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:22.286678 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-22effce7-a8d4-40f2-ba8d-34b9657540ed tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: d86c93ea-a9ad-4b0c-bc25-18f3da5bb813] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:22.293415 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-22effce7-a8d4-40f2-ba8d-34b9657540ed tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:22.293415 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-22effce7-a8d4-40f2-ba8d-34b9657540ed tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:22.294177 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-22effce7-a8d4-40f2-ba8d-34b9657540ed tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:22.294601 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-22effce7-a8d4-40f2-ba8d-34b9657540ed tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:22.446593 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-22effce7-a8d4-40f2-ba8d-34b9657540ed tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:22.457335 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-22effce7-a8d4-40f2-ba8d-34b9657540ed tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813" status: 200 len: 1323 microversion: 2.1 time: 0.174809 Feb 16 14:27:22.457909 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 153/266] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:22 2022] GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813 => generated 1323 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:22.633245 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a9a4bd6c-3a52-481e-89bd-4225cad7886f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:22.633851 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a9a4bd6c-3a52-481e-89bd-4225cad7886f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:22.639711 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a9a4bd6c-3a52-481e-89bd-4225cad7886f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:22.640167 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a9a4bd6c-3a52-481e-89bd-4225cad7886f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:22.640952 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a9a4bd6c-3a52-481e-89bd-4225cad7886f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:22.641392 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a9a4bd6c-3a52-481e-89bd-4225cad7886f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:22.806091 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a9a4bd6c-3a52-481e-89bd-4225cad7886f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:22.815339 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a9a4bd6c-3a52-481e-89bd-4225cad7886f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:22.817018 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a9a4bd6c-3a52-481e-89bd-4225cad7886f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:22.818275 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a9a4bd6c-3a52-481e-89bd-4225cad7886f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1727 microversion: 2.20 time: 0.188699 Feb 16 14:27:22.818956 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 114/267] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:27:22 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1727 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:27:23.279692 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-97bf9350-a29f-4c2f-af8f-07e06f29fc97 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:23.280507 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-97bf9350-a29f-4c2f-af8f-07e06f29fc97 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:23.286242 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-97bf9350-a29f-4c2f-af8f-07e06f29fc97 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:23.286860 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-97bf9350-a29f-4c2f-af8f-07e06f29fc97 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:23.288105 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-97bf9350-a29f-4c2f-af8f-07e06f29fc97 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:23.288105 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-97bf9350-a29f-4c2f-af8f-07e06f29fc97 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:23.313113 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-61d34782-fe23-4aeb-85d8-2989f6f78a9c tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a9391a2-82da-482d-ac1f-0887b643668a"}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:27:23.316762 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-61d34782-fe23-4aeb-85d8-2989f6f78a9c tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:23.320581 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-61d34782-fe23-4aeb-85d8-2989f6f78a9c tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:23.321030 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-61d34782-fe23-4aeb-85d8-2989f6f78a9c tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:23.321808 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-61d34782-fe23-4aeb-85d8-2989f6f78a9c tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:23.322331 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-61d34782-fe23-4aeb-85d8-2989f6f78a9c tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:23.429824 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-97bf9350-a29f-4c2f-af8f-07e06f29fc97 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:23.443882 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-97bf9350-a29f-4c2f-af8f-07e06f29fc97 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1525 microversion: 2.1 time: 0.168661 Feb 16 14:27:23.444786 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 154/268] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:23 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1525 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:23.473203 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-101d04bc-09a5-4b25-8ee0-211b055074c2 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:23.473902 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-101d04bc-09a5-4b25-8ee0-211b055074c2 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: d86c93ea-a9ad-4b0c-bc25-18f3da5bb813] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:23.479896 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-101d04bc-09a5-4b25-8ee0-211b055074c2 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:23.480454 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-101d04bc-09a5-4b25-8ee0-211b055074c2 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:23.481420 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-101d04bc-09a5-4b25-8ee0-211b055074c2 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:23.481924 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-101d04bc-09a5-4b25-8ee0-211b055074c2 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:23.620602 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-101d04bc-09a5-4b25-8ee0-211b055074c2 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:23.628771 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-101d04bc-09a5-4b25-8ee0-211b055074c2 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813" status: 200 len: 1323 microversion: 2.1 time: 0.159254 Feb 16 14:27:23.629422 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 155/269] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:23 2022] GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813 => generated 1323 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:23.837398 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-7f52d529-ca3c-4b27-8d13-1518e81eba6c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:23.838161 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-7f52d529-ca3c-4b27-8d13-1518e81eba6c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:23.846227 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7f52d529-ca3c-4b27-8d13-1518e81eba6c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:23.846986 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7f52d529-ca3c-4b27-8d13-1518e81eba6c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:23.848024 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7f52d529-ca3c-4b27-8d13-1518e81eba6c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:23.848632 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7f52d529-ca3c-4b27-8d13-1518e81eba6c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:24.004057 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-7f52d529-ca3c-4b27-8d13-1518e81eba6c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:24.009887 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-7f52d529-ca3c-4b27-8d13-1518e81eba6c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:24.011555 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-7f52d529-ca3c-4b27-8d13-1518e81eba6c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:24.013107 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-7f52d529-ca3c-4b27-8d13-1518e81eba6c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1727 microversion: 2.20 time: 0.179491 Feb 16 14:27:24.024479 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 156/270] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:27:23 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1727 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:27:24.180265 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-0873727f-b1a9-4a41-8699-f4ac8b2e969f req-b63948ff-21c0-4599-b86d-6dae0a21c570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d86c93ea-a9ad-4b0c-bc25-18f3da5bb813", "name": "network-vif-plugged", "status": "completed", "tag": "0bb1f89d-e659-4b77-826a-fe2b1eebc599"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:27:24.182323 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:27:24.182323 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:27:24.190217 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-0873727f-b1a9-4a41-8699-f4ac8b2e969f req-b63948ff-21c0-4599-b86d-6dae0a21c570 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:24.190945 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-0873727f-b1a9-4a41-8699-f4ac8b2e969f req-b63948ff-21c0-4599-b86d-6dae0a21c570 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:24.202257 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-0873727f-b1a9-4a41-8699-f4ac8b2e969f req-b63948ff-21c0-4599-b86d-6dae0a21c570 service nova] Creating event network-vif-plugged:0bb1f89d-e659-4b77-826a-fe2b1eebc599 for instance d86c93ea-a9ad-4b0c-bc25-18f3da5bb813 on hv-cinder-80473 Feb 16 14:27:24.207601 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-0873727f-b1a9-4a41-8699-f4ac8b2e969f req-b63948ff-21c0-4599-b86d-6dae0a21c570 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031435 Feb 16 14:27:24.208466 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 157/271] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 14:27:24.249847 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-61d34782-fe23-4aeb-85d8-2989f6f78a9c tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "POST /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.940340 Feb 16 14:27:24.250447 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 115/272] 10.222.0.110 () {60 vars in 1327 bytes} [Wed Feb 16 14:27:23 2022] POST /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35/os-volume_attachments => generated 194 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 14:27:24.467446 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-a89afac7-1465-4b7f-b5db-4f034366a75f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:24.468245 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-a89afac7-1465-4b7f-b5db-4f034366a75f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:24.474922 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a89afac7-1465-4b7f-b5db-4f034366a75f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:24.475379 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a89afac7-1465-4b7f-b5db-4f034366a75f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:24.476351 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a89afac7-1465-4b7f-b5db-4f034366a75f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:24.479161 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a89afac7-1465-4b7f-b5db-4f034366a75f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:24.646659 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-a89afac7-1465-4b7f-b5db-4f034366a75f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:24.646826 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a46bd06d-4903-4576-a7ff-d14b3640e089 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:24.647442 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a46bd06d-4903-4576-a7ff-d14b3640e089 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: d86c93ea-a9ad-4b0c-bc25-18f3da5bb813] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:24.653642 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a46bd06d-4903-4576-a7ff-d14b3640e089 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:24.654094 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a46bd06d-4903-4576-a7ff-d14b3640e089 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:24.654219 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-a89afac7-1465-4b7f-b5db-4f034366a75f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1525 microversion: 2.1 time: 0.192832 Feb 16 14:27:24.654861 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 158/273] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:24 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1525 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:24.654993 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a46bd06d-4903-4576-a7ff-d14b3640e089 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:24.655340 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a46bd06d-4903-4576-a7ff-d14b3640e089 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:24.892651 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a46bd06d-4903-4576-a7ff-d14b3640e089 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:24.899915 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a46bd06d-4903-4576-a7ff-d14b3640e089 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813" status: 200 len: 1323 microversion: 2.1 time: 0.257617 Feb 16 14:27:24.900483 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 116/274] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:24 2022] GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813 => generated 1323 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:27:25.032500 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-64f1cd8a-4686-4d74-b0cb-42da6c58fd4a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:25.033341 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-64f1cd8a-4686-4d74-b0cb-42da6c58fd4a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:25.039328 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-64f1cd8a-4686-4d74-b0cb-42da6c58fd4a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:25.039777 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-64f1cd8a-4686-4d74-b0cb-42da6c58fd4a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:25.040596 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-64f1cd8a-4686-4d74-b0cb-42da6c58fd4a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:25.041035 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-64f1cd8a-4686-4d74-b0cb-42da6c58fd4a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:25.208679 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-64f1cd8a-4686-4d74-b0cb-42da6c58fd4a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:25.217881 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-64f1cd8a-4686-4d74-b0cb-42da6c58fd4a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:25.219839 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-64f1cd8a-4686-4d74-b0cb-42da6c58fd4a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:25.220902 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-64f1cd8a-4686-4d74-b0cb-42da6c58fd4a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1727 microversion: 2.20 time: 0.193160 Feb 16 14:27:25.221460 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 159/275] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:27:25 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1727 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:27:25.680556 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-dffcdec5-723d-4781-8ea7-53ae62c577b1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:25.680556 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-dffcdec5-723d-4781-8ea7-53ae62c577b1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:25.690386 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dffcdec5-723d-4781-8ea7-53ae62c577b1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:25.692030 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dffcdec5-723d-4781-8ea7-53ae62c577b1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:25.692848 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dffcdec5-723d-4781-8ea7-53ae62c577b1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:25.693304 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dffcdec5-723d-4781-8ea7-53ae62c577b1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:25.848266 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-dffcdec5-723d-4781-8ea7-53ae62c577b1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:25.858998 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-dffcdec5-723d-4781-8ea7-53ae62c577b1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1525 microversion: 2.1 time: 0.188853 Feb 16 14:27:25.859612 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 117/276] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:25 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1525 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:25.916848 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-e609ec90-51ac-41ed-ae92-bfa24db0fbd8 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:25.917530 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-e609ec90-51ac-41ed-ae92-bfa24db0fbd8 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: d86c93ea-a9ad-4b0c-bc25-18f3da5bb813] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:25.924619 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e609ec90-51ac-41ed-ae92-bfa24db0fbd8 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:25.925061 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e609ec90-51ac-41ed-ae92-bfa24db0fbd8 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:25.925839 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e609ec90-51ac-41ed-ae92-bfa24db0fbd8 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:25.926270 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e609ec90-51ac-41ed-ae92-bfa24db0fbd8 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:26.059699 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-e609ec90-51ac-41ed-ae92-bfa24db0fbd8 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:26.068938 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-e609ec90-51ac-41ed-ae92-bfa24db0fbd8 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813" status: 200 len: 1323 microversion: 2.1 time: 0.154835 Feb 16 14:27:26.068938 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 160/277] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:25 2022] GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813 => generated 1323 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:26.239911 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-9858075b-3f42-455c-af5b-2700f424edd7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:26.240523 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-9858075b-3f42-455c-af5b-2700f424edd7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:26.246887 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9858075b-3f42-455c-af5b-2700f424edd7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:26.247344 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9858075b-3f42-455c-af5b-2700f424edd7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:26.248116 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9858075b-3f42-455c-af5b-2700f424edd7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:26.248556 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9858075b-3f42-455c-af5b-2700f424edd7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:26.448005 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-9858075b-3f42-455c-af5b-2700f424edd7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:26.457503 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-9858075b-3f42-455c-af5b-2700f424edd7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:26.459959 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-9858075b-3f42-455c-af5b-2700f424edd7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:26.460341 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-9858075b-3f42-455c-af5b-2700f424edd7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1727 microversion: 2.20 time: 0.224316 Feb 16 14:27:26.461198 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 118/278] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:27:26 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1727 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:27:26.876371 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-15ed647c-8791-498c-a304-8323eda777e8 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:26.876983 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-15ed647c-8791-498c-a304-8323eda777e8 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:26.891519 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-15ed647c-8791-498c-a304-8323eda777e8 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:26.891970 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-15ed647c-8791-498c-a304-8323eda777e8 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:26.892777 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-15ed647c-8791-498c-a304-8323eda777e8 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:26.893210 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-15ed647c-8791-498c-a304-8323eda777e8 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:27.063155 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-15ed647c-8791-498c-a304-8323eda777e8 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:27.072411 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-15ed647c-8791-498c-a304-8323eda777e8 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1505 microversion: 2.1 time: 0.200629 Feb 16 14:27:27.074914 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 161/279] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:26 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1505 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:27.091991 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-df57c478-47fc-4b4b-9a44-d71d3585a770 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:27.091991 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-df57c478-47fc-4b4b-9a44-d71d3585a770 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: d86c93ea-a9ad-4b0c-bc25-18f3da5bb813] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:27.106859 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-26219af2-5f1a-4cdc-a988-771943d489ae tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ec9c889-5493-4af3-8281-aaacce42e436"}} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:27:27.108009 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-df57c478-47fc-4b4b-9a44-d71d3585a770 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:27.108638 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-df57c478-47fc-4b4b-9a44-d71d3585a770 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:27.109745 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-df57c478-47fc-4b4b-9a44-d71d3585a770 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:27.111369 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-26219af2-5f1a-4cdc-a988-771943d489ae tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:27.112479 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-df57c478-47fc-4b4b-9a44-d71d3585a770 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:27.128741 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-26219af2-5f1a-4cdc-a988-771943d489ae tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:27.129200 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-26219af2-5f1a-4cdc-a988-771943d489ae tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:27.133727 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-26219af2-5f1a-4cdc-a988-771943d489ae tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:27.134674 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-26219af2-5f1a-4cdc-a988-771943d489ae tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:27.182697 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.wsgi [None req-26219af2-5f1a-4cdc-a988-771943d489ae tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] HTTP exception thrown: Cannot 'attach_volume' instance 05accb7b-6275-4c8e-a18b-69b67bdc1d8d while it is in vm_state rescued Feb 16 14:27:27.183485 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-26219af2-5f1a-4cdc-a988-771943d489ae tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Returning 409 to user: Cannot 'attach_volume' instance 05accb7b-6275-4c8e-a18b-69b67bdc1d8d while it is in vm_state rescued {{(pid=117031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:27:27.185403 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-26219af2-5f1a-4cdc-a988-771943d489ae tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "POST /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.092553 Feb 16 14:27:27.190122 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 162/280] 10.222.0.110 () {60 vars in 1327 bytes} [Wed Feb 16 14:27:27 2022] POST /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d/os-volume_attachments => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 16 14:27:27.196560 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-b09b29e9-2c21-40a0-96d4-46bc0e005324 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:27:27.197337 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-b09b29e9-2c21-40a0-96d4-46bc0e005324 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:27.205925 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b09b29e9-2c21-40a0-96d4-46bc0e005324 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:27.206707 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b09b29e9-2c21-40a0-96d4-46bc0e005324 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:27.207680 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b09b29e9-2c21-40a0-96d4-46bc0e005324 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:27.208431 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b09b29e9-2c21-40a0-96d4-46bc0e005324 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:27.344445 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-df57c478-47fc-4b4b-9a44-d71d3585a770 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:27.358035 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-df57c478-47fc-4b4b-9a44-d71d3585a770 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813" status: 200 len: 1513 microversion: 2.1 time: 0.276010 Feb 16 14:27:27.359150 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 119/281] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:27 2022] GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813 => generated 1513 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:27.420979 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-b09b29e9-2c21-40a0-96d4-46bc0e005324 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "POST /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d/action" status: 202 len: 0 microversion: 2.1 time: 0.228976 Feb 16 14:27:27.422032 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 163/282] 10.222.0.110 () {60 vars in 1282 bytes} [Wed Feb 16 14:27:27 2022] POST /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 14:27:27.442726 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a7257fb7-82c2-4339-94b5-62f134ad840e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:27.446267 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a7257fb7-82c2-4339-94b5-62f134ad840e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:27.457252 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a7257fb7-82c2-4339-94b5-62f134ad840e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:27.457497 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a7257fb7-82c2-4339-94b5-62f134ad840e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:27.457497 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a7257fb7-82c2-4339-94b5-62f134ad840e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:27.457497 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a7257fb7-82c2-4339-94b5-62f134ad840e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:27.483128 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-4f913c34-af3c-4f77-b8fc-663652f2fec3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:27.483230 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-4f913c34-af3c-4f77-b8fc-663652f2fec3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:27.504868 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4f913c34-af3c-4f77-b8fc-663652f2fec3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:27.505610 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4f913c34-af3c-4f77-b8fc-663652f2fec3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:27.506421 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4f913c34-af3c-4f77-b8fc-663652f2fec3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:27.506957 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4f913c34-af3c-4f77-b8fc-663652f2fec3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:27.700303 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-4f913c34-af3c-4f77-b8fc-663652f2fec3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:27.712431 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-4f913c34-af3c-4f77-b8fc-663652f2fec3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:27.720918 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-4f913c34-af3c-4f77-b8fc-663652f2fec3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:27.720918 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-4f913c34-af3c-4f77-b8fc-663652f2fec3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1727 microversion: 2.20 time: 0.241745 Feb 16 14:27:27.720918 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 164/283] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:27:27 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1727 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:27:27.780880 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a7257fb7-82c2-4339-94b5-62f134ad840e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:27.789134 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a7257fb7-82c2-4339-94b5-62f134ad840e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1513 microversion: 2.1 time: 0.358171 Feb 16 14:27:27.789719 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 120/284] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:27 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1513 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:28.736470 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-e600dd67-d3a7-447c-827e-63ef481108a9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:28.737560 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-e600dd67-d3a7-447c-827e-63ef481108a9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:28.744479 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e600dd67-d3a7-447c-827e-63ef481108a9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:28.744893 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e600dd67-d3a7-447c-827e-63ef481108a9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:28.745958 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e600dd67-d3a7-447c-827e-63ef481108a9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:28.747143 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e600dd67-d3a7-447c-827e-63ef481108a9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:28.808103 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-5f77c2f9-3eab-437c-b72a-2749665dbbd3 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:28.808917 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-5f77c2f9-3eab-437c-b72a-2749665dbbd3 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:28.819461 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5f77c2f9-3eab-437c-b72a-2749665dbbd3 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:28.820057 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5f77c2f9-3eab-437c-b72a-2749665dbbd3 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:28.821763 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5f77c2f9-3eab-437c-b72a-2749665dbbd3 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:28.822766 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5f77c2f9-3eab-437c-b72a-2749665dbbd3 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:28.955040 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-e600dd67-d3a7-447c-827e-63ef481108a9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:28.970073 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-e600dd67-d3a7-447c-827e-63ef481108a9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:28.973240 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-e600dd67-d3a7-447c-827e-63ef481108a9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:28.975277 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-e600dd67-d3a7-447c-827e-63ef481108a9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1727 microversion: 2.20 time: 0.242341 Feb 16 14:27:28.976865 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 165/285] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:27:28 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1727 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:27:29.060214 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-5f77c2f9-3eab-437c-b72a-2749665dbbd3 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:29.067879 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-5f77c2f9-3eab-437c-b72a-2749665dbbd3 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1513 microversion: 2.1 time: 0.264912 Feb 16 14:27:29.068457 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 121/286] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:28 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1513 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:27:29.995157 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-d58585a5-0f59-4fcc-8e66-224923dd6ecc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:29.995765 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-d58585a5-0f59-4fcc-8e66-224923dd6ecc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:30.002472 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d58585a5-0f59-4fcc-8e66-224923dd6ecc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:30.002964 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d58585a5-0f59-4fcc-8e66-224923dd6ecc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:30.003826 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d58585a5-0f59-4fcc-8e66-224923dd6ecc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:30.004151 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d58585a5-0f59-4fcc-8e66-224923dd6ecc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:30.093252 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ee1eff6d-efcd-44b8-aff2-a6c87d832679 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:30.096358 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ee1eff6d-efcd-44b8-aff2-a6c87d832679 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:30.105641 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ee1eff6d-efcd-44b8-aff2-a6c87d832679 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:30.106143 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ee1eff6d-efcd-44b8-aff2-a6c87d832679 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:30.107091 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ee1eff6d-efcd-44b8-aff2-a6c87d832679 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:30.107529 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ee1eff6d-efcd-44b8-aff2-a6c87d832679 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:30.171266 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-d58585a5-0f59-4fcc-8e66-224923dd6ecc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:30.180778 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-d58585a5-0f59-4fcc-8e66-224923dd6ecc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:30.191655 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-d58585a5-0f59-4fcc-8e66-224923dd6ecc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:30.191655 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-d58585a5-0f59-4fcc-8e66-224923dd6ecc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1727 microversion: 2.20 time: 0.193237 Feb 16 14:27:30.191655 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 166/287] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:27:29 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1727 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:27:30.310316 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ee1eff6d-efcd-44b8-aff2-a6c87d832679 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:30.318205 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ee1eff6d-efcd-44b8-aff2-a6c87d832679 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1513 microversion: 2.1 time: 0.236444 Feb 16 14:27:30.318813 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 122/288] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:30 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1513 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:31.204681 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-3064089d-c715-4b9a-842b-231ecc55474d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:31.205865 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-3064089d-c715-4b9a-842b-231ecc55474d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:31.212773 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3064089d-c715-4b9a-842b-231ecc55474d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:31.213220 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3064089d-c715-4b9a-842b-231ecc55474d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:31.214006 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3064089d-c715-4b9a-842b-231ecc55474d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:31.214436 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3064089d-c715-4b9a-842b-231ecc55474d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:31.335213 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-3c1df6a3-dd25-45ba-a506-8ec541b0eb22 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:31.336228 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-3c1df6a3-dd25-45ba-a506-8ec541b0eb22 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:31.345207 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3c1df6a3-dd25-45ba-a506-8ec541b0eb22 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:31.345669 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3c1df6a3-dd25-45ba-a506-8ec541b0eb22 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:31.346475 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3c1df6a3-dd25-45ba-a506-8ec541b0eb22 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:31.346942 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3c1df6a3-dd25-45ba-a506-8ec541b0eb22 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:31.364671 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-3064089d-c715-4b9a-842b-231ecc55474d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:31.376812 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-3064089d-c715-4b9a-842b-231ecc55474d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:31.378986 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-3064089d-c715-4b9a-842b-231ecc55474d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:31.384264 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-3064089d-c715-4b9a-842b-231ecc55474d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1727 microversion: 2.20 time: 0.180203 Feb 16 14:27:31.385860 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 167/289] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:27:31 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1727 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:27:31.599414 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3c1df6a3-dd25-45ba-a506-8ec541b0eb22 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:31.611691 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-3c1df6a3-dd25-45ba-a506-8ec541b0eb22 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1519 microversion: 2.1 time: 0.280735 Feb 16 14:27:31.624265 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 123/290] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:31 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1519 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:27:32.408654 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-2082a55d-a859-4d93-9e3c-fc808633b9f5 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:32.411245 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-2082a55d-a859-4d93-9e3c-fc808633b9f5 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:32.418134 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-2082a55d-a859-4d93-9e3c-fc808633b9f5 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:32.418589 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-2082a55d-a859-4d93-9e3c-fc808633b9f5 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:32.419584 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-2082a55d-a859-4d93-9e3c-fc808633b9f5 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:32.420027 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-2082a55d-a859-4d93-9e3c-fc808633b9f5 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:32.693358 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-2082a55d-a859-4d93-9e3c-fc808633b9f5 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:32.703449 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-2082a55d-a859-4d93-9e3c-fc808633b9f5 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:32.705211 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-9c98de72-f6d8-4ae7-aebb-b39ee7791e1c tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-92780310", "imageRef": "2493d2dc-e081-43d3-8292-91b4762a21e8", "flavorRef": "452", "networks": [{"uuid": "835d5ce9-a339-46c8-92e9-bdcd224e11f0"}]}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:27:32.705681 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-2082a55d-a859-4d93-9e3c-fc808633b9f5 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:32.706382 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-2082a55d-a859-4d93-9e3c-fc808633b9f5 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1727 microversion: 2.20 time: 0.303441 Feb 16 14:27:32.707111 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 168/291] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:27:32 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1727 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:27:32.774937 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.network.neutron [None req-9c98de72-f6d8-4ae7-aebb-b39ee7791e1c tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] validate_networks() for [('835d5ce9-a339-46c8-92e9-bdcd224e11f0', None, None, None, None, None)] {{(pid=117032) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 16 14:27:32.936688 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-0d5db18c-55fb-46f9-9736-da8a19e8da61 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:27:32.942782 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0d5db18c-55fb-46f9-9736-da8a19e8da61 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:32.943532 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0d5db18c-55fb-46f9-9736-da8a19e8da61 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:33.008948 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-0d5db18c-55fb-46f9-9736-da8a19e8da61 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Going to try to stop instance {{(pid=117031) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Feb 16 14:27:33.161484 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-9c98de72-f6d8-4ae7-aebb-b39ee7791e1c tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Flavor limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 16 14:27:33.162004 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-9c98de72-f6d8-4ae7-aebb-b39ee7791e1c tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Image limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 16 14:27:33.162594 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-9c98de72-f6d8-4ae7-aebb-b39ee7791e1c tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Flavor pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 16 14:27:33.163718 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-9c98de72-f6d8-4ae7-aebb-b39ee7791e1c tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Image pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 16 14:27:33.163718 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-9c98de72-f6d8-4ae7-aebb-b39ee7791e1c tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 16 14:27:33.174080 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9c98de72-f6d8-4ae7-aebb-b39ee7791e1c tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:33.174763 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9c98de72-f6d8-4ae7-aebb-b39ee7791e1c tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:33.176119 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9c98de72-f6d8-4ae7-aebb-b39ee7791e1c tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:33.176119 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9c98de72-f6d8-4ae7-aebb-b39ee7791e1c tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:33.186581 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-0d5db18c-55fb-46f9-9736-da8a19e8da61 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "POST /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35/action" status: 202 len: 0 microversion: 2.1 time: 0.252838 Feb 16 14:27:33.191228 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 169/292] 10.222.0.110 () {60 vars in 1282 bytes} [Wed Feb 16 14:27:32 2022] POST /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 14:27:33.195115 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-9c98de72-f6d8-4ae7-aebb-b39ee7791e1c tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Getting quotas for project 3d3028599f374f01812a61120701fb2f. Resources: {'cores', 'instances', 'ram'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 14:27:33.197049 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-e1fa1a37-6bea-4aa2-b3e8-aea1edaa6927 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:33.198046 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-e1fa1a37-6bea-4aa2-b3e8-aea1edaa6927 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:33.200023 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-9c98de72-f6d8-4ae7-aebb-b39ee7791e1c tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Getting quotas for user 642800fd0f7b4d5faa698f594b493bce and project 3d3028599f374f01812a61120701fb2f. Resources: {'cores', 'instances', 'ram'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 14:27:33.205872 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e1fa1a37-6bea-4aa2-b3e8-aea1edaa6927 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:33.208115 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e1fa1a37-6bea-4aa2-b3e8-aea1edaa6927 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:33.208115 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e1fa1a37-6bea-4aa2-b3e8-aea1edaa6927 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:33.208115 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e1fa1a37-6bea-4aa2-b3e8-aea1edaa6927 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:33.214585 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-9c98de72-f6d8-4ae7-aebb-b39ee7791e1c tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Going to run 1 instances... {{(pid=117032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 16 14:27:33.218101 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-9c98de72-f6d8-4ae7-aebb-b39ee7791e1c tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: fc5d63f6-7400-4c39-8626-4d580eed9967] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2493d2dc-e081-43d3-8292-91b4762a21e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 16 14:27:33.371858 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-e1fa1a37-6bea-4aa2-b3e8-aea1edaa6927 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:33.381446 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-e1fa1a37-6bea-4aa2-b3e8-aea1edaa6927 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1725 microversion: 2.1 time: 0.189020 Feb 16 14:27:33.382295 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 170/293] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:33 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1725 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:33.457960 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-9c98de72-f6d8-4ae7-aebb-b39ee7791e1c tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.756515 Feb 16 14:27:33.458606 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 124/294] 10.222.0.110 () {60 vars in 1151 bytes} [Wed Feb 16 14:27:32 2022] POST /compute/v2.1/servers => generated 382 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Feb 16 14:27:33.470101 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-46552fdf-47c1-40f5-bbef-c4c326725969 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:33.470816 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-46552fdf-47c1-40f5-bbef-c4c326725969 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: fc5d63f6-7400-4c39-8626-4d580eed9967] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:33.528601 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-46552fdf-47c1-40f5-bbef-c4c326725969 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:33.535602 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-46552fdf-47c1-40f5-bbef-c4c326725969 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967" status: 200 len: 1216 microversion: 2.1 time: 0.070379 Feb 16 14:27:33.536356 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 171/295] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:33 2022] GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967 => generated 1216 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:33.726088 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-2252a621-810b-403e-b898-3cc065730a5a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:33.726723 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-2252a621-810b-403e-b898-3cc065730a5a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:33.734711 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2252a621-810b-403e-b898-3cc065730a5a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:33.735245 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2252a621-810b-403e-b898-3cc065730a5a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:33.736106 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2252a621-810b-403e-b898-3cc065730a5a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:33.736663 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2252a621-810b-403e-b898-3cc065730a5a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:34.100020 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-2252a621-810b-403e-b898-3cc065730a5a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:34.109398 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-2252a621-810b-403e-b898-3cc065730a5a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:34.111442 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-2252a621-810b-403e-b898-3cc065730a5a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:34.112796 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-2252a621-810b-403e-b898-3cc065730a5a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1727 microversion: 2.20 time: 0.391027 Feb 16 14:27:34.113476 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 125/296] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:27:33 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1727 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:27:34.371698 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-eec4a9f9-2928-4648-8d6f-47fa9792b863 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:34.372388 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-eec4a9f9-2928-4648-8d6f-47fa9792b863 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:34.378912 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-eec4a9f9-2928-4648-8d6f-47fa9792b863 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:34.379509 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-eec4a9f9-2928-4648-8d6f-47fa9792b863 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:34.380300 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-eec4a9f9-2928-4648-8d6f-47fa9792b863 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:34.380728 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-eec4a9f9-2928-4648-8d6f-47fa9792b863 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:34.399452 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-3712e1b4-e87d-4486-99c6-2a24aa94f7c0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:34.400074 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-3712e1b4-e87d-4486-99c6-2a24aa94f7c0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:34.409900 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3712e1b4-e87d-4486-99c6-2a24aa94f7c0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:34.410526 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3712e1b4-e87d-4486-99c6-2a24aa94f7c0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:34.411519 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3712e1b4-e87d-4486-99c6-2a24aa94f7c0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:34.412128 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3712e1b4-e87d-4486-99c6-2a24aa94f7c0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:34.530241 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-eec4a9f9-2928-4648-8d6f-47fa9792b863 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:34.555574 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-eec4a9f9-2928-4648-8d6f-47fa9792b863 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1519 microversion: 2.1 time: 0.186527 Feb 16 14:27:34.556554 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 172/297] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:34 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1519 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:34.570675 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-acf7796e-72d6-4514-81bf-d402cd0a7a4e tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:34.571272 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-acf7796e-72d6-4514-81bf-d402cd0a7a4e tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: fc5d63f6-7400-4c39-8626-4d580eed9967] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:34.572865 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3712e1b4-e87d-4486-99c6-2a24aa94f7c0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:34.581479 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-3712e1b4-e87d-4486-99c6-2a24aa94f7c0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1725 microversion: 2.1 time: 0.185617 Feb 16 14:27:34.582070 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 126/298] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:34 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:27:34.592499 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-1ac756c2-d93c-4be3-bc1d-3cbc4380adbd tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15362d59-8192-4046-828d-187fe4cc9190"}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:27:34.593845 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-1ac756c2-d93c-4be3-bc1d-3cbc4380adbd tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:34.600101 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1ac756c2-d93c-4be3-bc1d-3cbc4380adbd tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:34.600784 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1ac756c2-d93c-4be3-bc1d-3cbc4380adbd tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:34.601600 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1ac756c2-d93c-4be3-bc1d-3cbc4380adbd tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:34.602165 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1ac756c2-d93c-4be3-bc1d-3cbc4380adbd tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:34.628487 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-acf7796e-72d6-4514-81bf-d402cd0a7a4e tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:34.635587 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-acf7796e-72d6-4514-81bf-d402cd0a7a4e tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967" status: 200 len: 1216 microversion: 2.1 time: 0.075880 Feb 16 14:27:34.645518 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 173/299] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:34 2022] GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967 => generated 1216 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:35.132943 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-24886be2-4d88-45f8-acd5-4214103543b4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:35.133541 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-24886be2-4d88-45f8-acd5-4214103543b4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:35.141291 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-24886be2-4d88-45f8-acd5-4214103543b4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:35.141857 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-24886be2-4d88-45f8-acd5-4214103543b4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:35.143378 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-24886be2-4d88-45f8-acd5-4214103543b4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:35.143842 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-24886be2-4d88-45f8-acd5-4214103543b4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:35.293119 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-24886be2-4d88-45f8-acd5-4214103543b4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:35.302079 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-24886be2-4d88-45f8-acd5-4214103543b4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:35.303894 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-24886be2-4d88-45f8-acd5-4214103543b4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:35.305916 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-24886be2-4d88-45f8-acd5-4214103543b4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1727 microversion: 2.20 time: 0.176479 Feb 16 14:27:35.319565 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 174/300] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:27:35 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1727 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:27:35.591743 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-1ac756c2-d93c-4be3-bc1d-3cbc4380adbd tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "POST /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.008147 Feb 16 14:27:35.593069 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 127/301] 10.222.0.110 () {60 vars in 1327 bytes} [Wed Feb 16 14:27:34 2022] POST /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d/os-volume_attachments => generated 194 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:27:35.599027 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-4e280ec6-249a-41d2-9d4b-d180a319abaa tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:35.599639 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-4e280ec6-249a-41d2-9d4b-d180a319abaa tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:35.606211 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4e280ec6-249a-41d2-9d4b-d180a319abaa tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:35.606822 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4e280ec6-249a-41d2-9d4b-d180a319abaa tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:35.607706 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4e280ec6-249a-41d2-9d4b-d180a319abaa tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:35.608537 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4e280ec6-249a-41d2-9d4b-d180a319abaa tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:35.653264 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f31e2fa9-4897-40c6-a97c-1ba54108f096 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:35.654041 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f31e2fa9-4897-40c6-a97c-1ba54108f096 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: fc5d63f6-7400-4c39-8626-4d580eed9967] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:35.660475 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f31e2fa9-4897-40c6-a97c-1ba54108f096 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:35.661007 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f31e2fa9-4897-40c6-a97c-1ba54108f096 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:35.661798 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f31e2fa9-4897-40c6-a97c-1ba54108f096 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:35.662232 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f31e2fa9-4897-40c6-a97c-1ba54108f096 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:35.735723 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f31e2fa9-4897-40c6-a97c-1ba54108f096 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:35.749417 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f31e2fa9-4897-40c6-a97c-1ba54108f096 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967" status: 200 len: 1268 microversion: 2.1 time: 0.099293 Feb 16 14:27:35.750085 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 128/302] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:35 2022] GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967 => generated 1268 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:27:35.771217 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-4e280ec6-249a-41d2-9d4b-d180a319abaa tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:35.781270 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-4e280ec6-249a-41d2-9d4b-d180a319abaa tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1725 microversion: 2.1 time: 0.185321 Feb 16 14:27:35.783557 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 175/303] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:35 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1725 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:36.335371 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-d15d2820-2afe-43ba-9f96-f294387d87b3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:36.336125 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-d15d2820-2afe-43ba-9f96-f294387d87b3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:36.342914 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d15d2820-2afe-43ba-9f96-f294387d87b3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:36.343407 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d15d2820-2afe-43ba-9f96-f294387d87b3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:36.344295 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d15d2820-2afe-43ba-9f96-f294387d87b3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:36.344727 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d15d2820-2afe-43ba-9f96-f294387d87b3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:36.481874 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d15d2820-2afe-43ba-9f96-f294387d87b3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:36.491231 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d15d2820-2afe-43ba-9f96-f294387d87b3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:36.492768 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d15d2820-2afe-43ba-9f96-f294387d87b3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:36.494075 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-d15d2820-2afe-43ba-9f96-f294387d87b3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1727 microversion: 2.20 time: 0.162423 Feb 16 14:27:36.495234 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 129/304] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:27:36 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:27:36.768608 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-d6b3e442-7968-4ee8-b337-3fbb85ef765e tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:36.769813 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-d6b3e442-7968-4ee8-b337-3fbb85ef765e tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: fc5d63f6-7400-4c39-8626-4d580eed9967] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:36.776443 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d6b3e442-7968-4ee8-b337-3fbb85ef765e tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:36.776898 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d6b3e442-7968-4ee8-b337-3fbb85ef765e tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:36.777675 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d6b3e442-7968-4ee8-b337-3fbb85ef765e tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:36.778100 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d6b3e442-7968-4ee8-b337-3fbb85ef765e tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:36.804435 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-223a5d35-65fd-4ea7-82a9-d03e55df2c73 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:36.805360 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-223a5d35-65fd-4ea7-82a9-d03e55df2c73 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:36.814908 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-223a5d35-65fd-4ea7-82a9-d03e55df2c73 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:36.817407 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-223a5d35-65fd-4ea7-82a9-d03e55df2c73 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:36.820493 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-223a5d35-65fd-4ea7-82a9-d03e55df2c73 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:36.823439 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-223a5d35-65fd-4ea7-82a9-d03e55df2c73 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:36.848833 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-d6b3e442-7968-4ee8-b337-3fbb85ef765e tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:36.856134 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-d6b3e442-7968-4ee8-b337-3fbb85ef765e tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967" status: 200 len: 1276 microversion: 2.1 time: 0.093379 Feb 16 14:27:36.856699 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 176/305] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:36 2022] GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967 => generated 1276 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:36.991272 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-223a5d35-65fd-4ea7-82a9-d03e55df2c73 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:37.000197 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-223a5d35-65fd-4ea7-82a9-d03e55df2c73 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1725 microversion: 2.1 time: 0.199626 Feb 16 14:27:37.000900 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 130/306] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:36 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1725 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:37.512908 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-9a578ff7-bcba-47f7-9505-c2130ae224e1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:37.513421 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-9a578ff7-bcba-47f7-9505-c2130ae224e1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:37.519341 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9a578ff7-bcba-47f7-9505-c2130ae224e1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:37.519780 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9a578ff7-bcba-47f7-9505-c2130ae224e1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:37.520537 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9a578ff7-bcba-47f7-9505-c2130ae224e1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:37.520961 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9a578ff7-bcba-47f7-9505-c2130ae224e1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:37.662682 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-9a578ff7-bcba-47f7-9505-c2130ae224e1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:37.671808 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-9a578ff7-bcba-47f7-9505-c2130ae224e1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:37.673464 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-9a578ff7-bcba-47f7-9505-c2130ae224e1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:37.674730 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-9a578ff7-bcba-47f7-9505-c2130ae224e1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1727 microversion: 2.20 time: 0.165697 Feb 16 14:27:37.675437 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 177/307] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:27:37 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:27:37.879713 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-094b5ab4-17c5-437a-b2a1-ac31e14658da tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:37.880325 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-094b5ab4-17c5-437a-b2a1-ac31e14658da tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: fc5d63f6-7400-4c39-8626-4d580eed9967] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:37.886592 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-094b5ab4-17c5-437a-b2a1-ac31e14658da tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:37.887078 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-094b5ab4-17c5-437a-b2a1-ac31e14658da tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:37.887855 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-094b5ab4-17c5-437a-b2a1-ac31e14658da tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:37.888288 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-094b5ab4-17c5-437a-b2a1-ac31e14658da tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:38.017153 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-0563b808-d6f4-4f00-82b9-7e940e12e3a9 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:38.017753 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-0563b808-d6f4-4f00-82b9-7e940e12e3a9 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:38.023545 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0563b808-d6f4-4f00-82b9-7e940e12e3a9 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:38.023931 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0563b808-d6f4-4f00-82b9-7e940e12e3a9 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:38.024705 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0563b808-d6f4-4f00-82b9-7e940e12e3a9 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:38.025136 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0563b808-d6f4-4f00-82b9-7e940e12e3a9 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:38.042334 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-094b5ab4-17c5-437a-b2a1-ac31e14658da tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:38.050414 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-094b5ab4-17c5-437a-b2a1-ac31e14658da tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967" status: 200 len: 1316 microversion: 2.1 time: 0.174628 Feb 16 14:27:38.051024 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 131/308] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:37 2022] GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967 => generated 1316 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:38.160811 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-0563b808-d6f4-4f00-82b9-7e940e12e3a9 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:38.168446 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-0563b808-d6f4-4f00-82b9-7e940e12e3a9 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1725 microversion: 2.1 time: 0.155111 Feb 16 14:27:38.169016 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 178/309] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:38 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:27:38.693833 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ecfeb93b-e88c-42b5-9a74-0a594b520210 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:38.694334 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ecfeb93b-e88c-42b5-9a74-0a594b520210 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:38.700154 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ecfeb93b-e88c-42b5-9a74-0a594b520210 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:38.700722 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ecfeb93b-e88c-42b5-9a74-0a594b520210 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:38.701510 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ecfeb93b-e88c-42b5-9a74-0a594b520210 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:38.701939 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ecfeb93b-e88c-42b5-9a74-0a594b520210 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:38.833998 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ecfeb93b-e88c-42b5-9a74-0a594b520210 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:38.841823 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ecfeb93b-e88c-42b5-9a74-0a594b520210 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:38.843980 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ecfeb93b-e88c-42b5-9a74-0a594b520210 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:38.845119 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ecfeb93b-e88c-42b5-9a74-0a594b520210 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1727 microversion: 2.20 time: 0.155308 Feb 16 14:27:38.845675 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 132/310] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:27:38 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:27:39.067122 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-142d39dc-da5e-4cc3-aacd-e9d0905595b4 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:39.067748 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-142d39dc-da5e-4cc3-aacd-e9d0905595b4 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: fc5d63f6-7400-4c39-8626-4d580eed9967] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:39.073567 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-142d39dc-da5e-4cc3-aacd-e9d0905595b4 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:39.074011 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-142d39dc-da5e-4cc3-aacd-e9d0905595b4 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:39.074803 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-142d39dc-da5e-4cc3-aacd-e9d0905595b4 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:39.075253 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-142d39dc-da5e-4cc3-aacd-e9d0905595b4 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:39.186413 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-7a0600a2-f387-447a-a868-0b7ba78c4d17 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:39.187162 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-7a0600a2-f387-447a-a868-0b7ba78c4d17 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:39.193375 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7a0600a2-f387-447a-a868-0b7ba78c4d17 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:39.193833 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7a0600a2-f387-447a-a868-0b7ba78c4d17 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:39.194636 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7a0600a2-f387-447a-a868-0b7ba78c4d17 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:39.195084 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7a0600a2-f387-447a-a868-0b7ba78c4d17 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:39.206916 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-142d39dc-da5e-4cc3-aacd-e9d0905595b4 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:39.214014 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-142d39dc-da5e-4cc3-aacd-e9d0905595b4 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967" status: 200 len: 1316 microversion: 2.1 time: 0.150455 Feb 16 14:27:39.214572 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 179/311] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:39 2022] GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967 => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:39.329399 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-7a0600a2-f387-447a-a868-0b7ba78c4d17 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:39.335656 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-7a0600a2-f387-447a-a868-0b7ba78c4d17 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1725 microversion: 2.1 time: 0.153351 Feb 16 14:27:39.336236 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 133/312] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:39 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:27:39.863326 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-91761417-d504-4777-aa94-3f5a1ea4c83c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:39.863917 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-91761417-d504-4777-aa94-3f5a1ea4c83c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:39.869706 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-91761417-d504-4777-aa94-3f5a1ea4c83c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:39.870154 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-91761417-d504-4777-aa94-3f5a1ea4c83c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:39.870944 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-91761417-d504-4777-aa94-3f5a1ea4c83c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:39.871370 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-91761417-d504-4777-aa94-3f5a1ea4c83c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:40.005183 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-91761417-d504-4777-aa94-3f5a1ea4c83c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:40.012782 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-91761417-d504-4777-aa94-3f5a1ea4c83c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:40.014271 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-91761417-d504-4777-aa94-3f5a1ea4c83c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:40.015425 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-91761417-d504-4777-aa94-3f5a1ea4c83c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1727 microversion: 2.20 time: 0.155759 Feb 16 14:27:40.015972 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 180/313] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:27:39 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:27:40.230240 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e44a75e0-5106-45d4-a8a2-2052f4414551 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:40.230876 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-e44a75e0-5106-45d4-a8a2-2052f4414551 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: fc5d63f6-7400-4c39-8626-4d580eed9967] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:40.237891 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e44a75e0-5106-45d4-a8a2-2052f4414551 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:40.238339 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e44a75e0-5106-45d4-a8a2-2052f4414551 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:40.239143 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e44a75e0-5106-45d4-a8a2-2052f4414551 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:40.239586 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e44a75e0-5106-45d4-a8a2-2052f4414551 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:40.352946 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-155d545e-6528-4e30-a95d-14ed6e78eed8 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:40.353554 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-155d545e-6528-4e30-a95d-14ed6e78eed8 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:40.359888 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-155d545e-6528-4e30-a95d-14ed6e78eed8 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:40.360337 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-155d545e-6528-4e30-a95d-14ed6e78eed8 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:40.361121 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-155d545e-6528-4e30-a95d-14ed6e78eed8 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:40.361555 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-155d545e-6528-4e30-a95d-14ed6e78eed8 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:40.478072 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-e44a75e0-5106-45d4-a8a2-2052f4414551 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:40.486303 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-e44a75e0-5106-45d4-a8a2-2052f4414551 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967" status: 200 len: 1316 microversion: 2.1 time: 0.259594 Feb 16 14:27:40.496934 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 134/314] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:40 2022] GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967 => generated 1316 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:40.503333 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-155d545e-6528-4e30-a95d-14ed6e78eed8 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:40.511912 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-155d545e-6528-4e30-a95d-14ed6e78eed8 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1725 microversion: 2.1 time: 0.162675 Feb 16 14:27:40.512585 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 181/315] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:40 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:27:41.033215 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-46350a96-761f-4285-ba0b-303af374f451 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:41.034013 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-46350a96-761f-4285-ba0b-303af374f451 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:41.039953 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-46350a96-761f-4285-ba0b-303af374f451 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:41.040343 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-46350a96-761f-4285-ba0b-303af374f451 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:41.041132 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-46350a96-761f-4285-ba0b-303af374f451 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:41.041571 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-46350a96-761f-4285-ba0b-303af374f451 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:41.140601 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-41a069ee-cb37-447d-8d59-06bcf559e503 req-ed23bb72-2d8b-40e7-a946-27ddc3fa33b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc5d63f6-7400-4c39-8626-4d580eed9967", "tag": "07087be6-f536-403f-9dc7-85cd0f4feb23"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:27:41.142210 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:27:41.142210 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:27:41.157941 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-41a069ee-cb37-447d-8d59-06bcf559e503 req-ed23bb72-2d8b-40e7-a946-27ddc3fa33b2 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:41.158487 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-41a069ee-cb37-447d-8d59-06bcf559e503 req-ed23bb72-2d8b-40e7-a946-27ddc3fa33b2 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:41.175739 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-41a069ee-cb37-447d-8d59-06bcf559e503 req-ed23bb72-2d8b-40e7-a946-27ddc3fa33b2 service nova] Creating event network-changed:07087be6-f536-403f-9dc7-85cd0f4feb23 for instance fc5d63f6-7400-4c39-8626-4d580eed9967 on hv-cinder-80473 Feb 16 14:27:41.181350 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-41a069ee-cb37-447d-8d59-06bcf559e503 req-ed23bb72-2d8b-40e7-a946-27ddc3fa33b2 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044875 Feb 16 14:27:41.182012 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 182/316] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 14:27:41.241371 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-46350a96-761f-4285-ba0b-303af374f451 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:41.250641 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-46350a96-761f-4285-ba0b-303af374f451 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:41.252591 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-46350a96-761f-4285-ba0b-303af374f451 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:41.253848 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-46350a96-761f-4285-ba0b-303af374f451 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1727 microversion: 2.20 time: 0.224433 Feb 16 14:27:41.254406 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 135/317] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:27:41 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1727 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:27:41.504307 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-088ab611-7239-4cd5-bcfa-ddc461858539 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:41.505006 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-088ab611-7239-4cd5-bcfa-ddc461858539 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: fc5d63f6-7400-4c39-8626-4d580eed9967] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:41.511019 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-088ab611-7239-4cd5-bcfa-ddc461858539 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:41.511462 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-088ab611-7239-4cd5-bcfa-ddc461858539 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:41.512240 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-088ab611-7239-4cd5-bcfa-ddc461858539 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:41.512671 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-088ab611-7239-4cd5-bcfa-ddc461858539 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:41.530280 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-fa46bc88-bd29-474a-872d-16061714f25a tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:41.531227 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-fa46bc88-bd29-474a-872d-16061714f25a tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:41.537101 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fa46bc88-bd29-474a-872d-16061714f25a tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:41.537551 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fa46bc88-bd29-474a-872d-16061714f25a tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:41.538340 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fa46bc88-bd29-474a-872d-16061714f25a tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:41.538869 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fa46bc88-bd29-474a-872d-16061714f25a tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:41.676301 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-088ab611-7239-4cd5-bcfa-ddc461858539 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:41.684598 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-088ab611-7239-4cd5-bcfa-ddc461858539 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967" status: 200 len: 1316 microversion: 2.1 time: 0.184453 Feb 16 14:27:41.685805 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 183/318] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:41 2022] GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967 => generated 1316 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:41.797917 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-fa46bc88-bd29-474a-872d-16061714f25a tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:41.805786 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-fa46bc88-bd29-474a-872d-16061714f25a tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1725 microversion: 2.1 time: 0.280336 Feb 16 14:27:41.806285 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 136/319] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:41 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1725 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:27:42.272094 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-29043a92-f1f0-4f9e-8832-741128f00f6e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:42.272706 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-29043a92-f1f0-4f9e-8832-741128f00f6e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:42.278696 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-29043a92-f1f0-4f9e-8832-741128f00f6e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:42.279148 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-29043a92-f1f0-4f9e-8832-741128f00f6e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:42.280205 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-29043a92-f1f0-4f9e-8832-741128f00f6e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:42.280641 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-29043a92-f1f0-4f9e-8832-741128f00f6e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:42.428829 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-29043a92-f1f0-4f9e-8832-741128f00f6e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:42.437418 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-29043a92-f1f0-4f9e-8832-741128f00f6e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:42.438957 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-29043a92-f1f0-4f9e-8832-741128f00f6e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:42.440216 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-29043a92-f1f0-4f9e-8832-741128f00f6e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1727 microversion: 2.20 time: 0.171836 Feb 16 14:27:42.440676 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 184/320] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:27:42 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:27:42.703324 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-88d9d6bb-3522-4f38-a2ac-b7581effae04 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:42.704129 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-88d9d6bb-3522-4f38-a2ac-b7581effae04 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: fc5d63f6-7400-4c39-8626-4d580eed9967] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:42.710464 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-88d9d6bb-3522-4f38-a2ac-b7581effae04 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:42.710954 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-88d9d6bb-3522-4f38-a2ac-b7581effae04 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:42.711725 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-88d9d6bb-3522-4f38-a2ac-b7581effae04 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:42.712163 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-88d9d6bb-3522-4f38-a2ac-b7581effae04 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:42.822602 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-07845b3a-3059-46b9-81ab-60ae975198fe tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:42.823365 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-07845b3a-3059-46b9-81ab-60ae975198fe tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:42.830156 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-07845b3a-3059-46b9-81ab-60ae975198fe tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:42.830608 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-07845b3a-3059-46b9-81ab-60ae975198fe tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:42.831416 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-07845b3a-3059-46b9-81ab-60ae975198fe tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:42.831987 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-07845b3a-3059-46b9-81ab-60ae975198fe tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:42.849785 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-88d9d6bb-3522-4f38-a2ac-b7581effae04 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:42.857225 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-88d9d6bb-3522-4f38-a2ac-b7581effae04 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967" status: 200 len: 1316 microversion: 2.1 time: 0.157671 Feb 16 14:27:42.857807 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 137/321] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:42 2022] GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967 => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:27:42.962010 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-07845b3a-3059-46b9-81ab-60ae975198fe tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:42.970855 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-07845b3a-3059-46b9-81ab-60ae975198fe tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1725 microversion: 2.1 time: 0.151927 Feb 16 14:27:42.971423 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 185/322] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:42 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:27:43.458988 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-73ba836d-973a-45ed-b94a-6f57f8143cee tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:43.459902 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-73ba836d-973a-45ed-b94a-6f57f8143cee tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:43.466054 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-73ba836d-973a-45ed-b94a-6f57f8143cee tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:43.469666 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-73ba836d-973a-45ed-b94a-6f57f8143cee tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:43.469666 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-73ba836d-973a-45ed-b94a-6f57f8143cee tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:43.469666 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-73ba836d-973a-45ed-b94a-6f57f8143cee tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:43.611542 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-73ba836d-973a-45ed-b94a-6f57f8143cee tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:43.620053 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-73ba836d-973a-45ed-b94a-6f57f8143cee tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:43.621804 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-73ba836d-973a-45ed-b94a-6f57f8143cee tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:43.623152 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-73ba836d-973a-45ed-b94a-6f57f8143cee tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1748 microversion: 2.20 time: 0.167859 Feb 16 14:27:43.634125 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 138/323] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:27:43 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1748 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:27:43.875338 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-9839b673-51de-462e-abcb-65444928c307 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:43.875998 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-9839b673-51de-462e-abcb-65444928c307 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: fc5d63f6-7400-4c39-8626-4d580eed9967] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:43.882274 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9839b673-51de-462e-abcb-65444928c307 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:43.882761 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9839b673-51de-462e-abcb-65444928c307 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:43.883585 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9839b673-51de-462e-abcb-65444928c307 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:43.884010 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9839b673-51de-462e-abcb-65444928c307 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:43.988750 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-4334e90f-e67d-4594-a685-e7d3876258e3 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:43.991116 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-4334e90f-e67d-4594-a685-e7d3876258e3 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:43.997003 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4334e90f-e67d-4594-a685-e7d3876258e3 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:43.997537 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4334e90f-e67d-4594-a685-e7d3876258e3 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:43.998445 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4334e90f-e67d-4594-a685-e7d3876258e3 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:44.000048 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4334e90f-e67d-4594-a685-e7d3876258e3 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:44.172088 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-4334e90f-e67d-4594-a685-e7d3876258e3 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:44.180703 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-4334e90f-e67d-4594-a685-e7d3876258e3 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1725 microversion: 2.1 time: 0.195784 Feb 16 14:27:44.181296 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 139/324] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:43 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:44.248700 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-9839b673-51de-462e-abcb-65444928c307 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:44.256301 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-9839b673-51de-462e-abcb-65444928c307 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967" status: 200 len: 1316 microversion: 2.1 time: 0.385211 Feb 16 14:27:44.256871 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 186/325] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:43 2022] GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967 => generated 1316 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:44.656959 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-2c9877b0-f2c0-4545-a40a-2bfad08ea2a7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:44.656959 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-2c9877b0-f2c0-4545-a40a-2bfad08ea2a7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:44.663947 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2c9877b0-f2c0-4545-a40a-2bfad08ea2a7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:44.664498 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2c9877b0-f2c0-4545-a40a-2bfad08ea2a7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:44.665227 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2c9877b0-f2c0-4545-a40a-2bfad08ea2a7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:44.665660 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2c9877b0-f2c0-4545-a40a-2bfad08ea2a7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:44.824625 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-2c9877b0-f2c0-4545-a40a-2bfad08ea2a7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:44.832951 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-2c9877b0-f2c0-4545-a40a-2bfad08ea2a7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:44.834484 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-2c9877b0-f2c0-4545-a40a-2bfad08ea2a7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:44.835758 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-2c9877b0-f2c0-4545-a40a-2bfad08ea2a7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1748 microversion: 2.20 time: 0.185081 Feb 16 14:27:44.836323 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 140/326] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:27:44 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1748 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:27:45.198148 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-37b9f7a1-fcad-4044-aa70-4e41914a50e9 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:45.198831 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-37b9f7a1-fcad-4044-aa70-4e41914a50e9 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:45.207089 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-37b9f7a1-fcad-4044-aa70-4e41914a50e9 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:45.207857 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-37b9f7a1-fcad-4044-aa70-4e41914a50e9 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:45.209357 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-37b9f7a1-fcad-4044-aa70-4e41914a50e9 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:45.210016 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-37b9f7a1-fcad-4044-aa70-4e41914a50e9 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:45.273507 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-7fb431e3-3add-4f92-baf0-2d64c6d1630c tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:45.274372 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-7fb431e3-3add-4f92-baf0-2d64c6d1630c tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: fc5d63f6-7400-4c39-8626-4d580eed9967] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:45.294228 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7fb431e3-3add-4f92-baf0-2d64c6d1630c tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:45.294725 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7fb431e3-3add-4f92-baf0-2d64c6d1630c tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:45.295928 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7fb431e3-3add-4f92-baf0-2d64c6d1630c tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:45.297924 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7fb431e3-3add-4f92-baf0-2d64c6d1630c tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:45.363783 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-37b9f7a1-fcad-4044-aa70-4e41914a50e9 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:45.372014 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-37b9f7a1-fcad-4044-aa70-4e41914a50e9 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1725 microversion: 2.1 time: 0.178115 Feb 16 14:27:45.382462 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 187/327] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:45 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:45.504716 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-7fb431e3-3add-4f92-baf0-2d64c6d1630c tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:45.512345 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-7fb431e3-3add-4f92-baf0-2d64c6d1630c tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967" status: 200 len: 1316 microversion: 2.1 time: 0.242419 Feb 16 14:27:45.512971 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 141/328] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:45 2022] GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967 => generated 1316 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:45.853786 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-4f0f5d98-e06b-4eeb-9197-1f961049f876 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:45.854395 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-4f0f5d98-e06b-4eeb-9197-1f961049f876 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:45.861074 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4f0f5d98-e06b-4eeb-9197-1f961049f876 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:45.861522 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4f0f5d98-e06b-4eeb-9197-1f961049f876 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:45.862298 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4f0f5d98-e06b-4eeb-9197-1f961049f876 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:45.862760 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4f0f5d98-e06b-4eeb-9197-1f961049f876 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:46.027894 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-4f0f5d98-e06b-4eeb-9197-1f961049f876 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:46.036489 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-4f0f5d98-e06b-4eeb-9197-1f961049f876 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:46.037988 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-4f0f5d98-e06b-4eeb-9197-1f961049f876 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:46.040560 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-4f0f5d98-e06b-4eeb-9197-1f961049f876 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1748 microversion: 2.20 time: 0.189243 Feb 16 14:27:46.040560 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 188/329] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:27:45 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1748 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:27:46.390318 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f813ebe3-8ebd-4c78-aa58-240cc6ba5c68 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:46.391843 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f813ebe3-8ebd-4c78-aa58-240cc6ba5c68 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:46.405192 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f813ebe3-8ebd-4c78-aa58-240cc6ba5c68 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:46.406040 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f813ebe3-8ebd-4c78-aa58-240cc6ba5c68 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:46.407015 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f813ebe3-8ebd-4c78-aa58-240cc6ba5c68 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:46.408263 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f813ebe3-8ebd-4c78-aa58-240cc6ba5c68 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:46.502721 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-4138eb58-35b3-4cf0-baf9-f546b8d839bd req-8ff88d83-35fe-43f1-998b-292eae71807d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2139817-3f2e-4e56-87d6-a56a2ca2f6f9", "name": "network-vif-plugged", "status": "completed", "tag": "e636434b-73f6-458a-9681-a71516b2260d"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:27:46.504410 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:27:46.504410 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:27:46.514283 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-4138eb58-35b3-4cf0-baf9-f546b8d839bd req-8ff88d83-35fe-43f1-998b-292eae71807d service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:46.514750 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-4138eb58-35b3-4cf0-baf9-f546b8d839bd req-8ff88d83-35fe-43f1-998b-292eae71807d service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:46.538097 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-4138eb58-35b3-4cf0-baf9-f546b8d839bd req-8ff88d83-35fe-43f1-998b-292eae71807d service nova] Creating event network-vif-plugged:e636434b-73f6-458a-9681-a71516b2260d for instance e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 on hv-cinder-80473 Feb 16 14:27:46.543013 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-4138eb58-35b3-4cf0-baf9-f546b8d839bd req-8ff88d83-35fe-43f1-998b-292eae71807d service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045532 Feb 16 14:27:46.543963 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 189/330] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 14:27:46.558006 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-35fff5a6-daa3-410e-a730-e4e4597d2d7b tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:46.558735 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-35fff5a6-daa3-410e-a730-e4e4597d2d7b tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: fc5d63f6-7400-4c39-8626-4d580eed9967] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:46.566321 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-35fff5a6-daa3-410e-a730-e4e4597d2d7b tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:46.567074 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-35fff5a6-daa3-410e-a730-e4e4597d2d7b tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:46.567928 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-35fff5a6-daa3-410e-a730-e4e4597d2d7b tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:46.568440 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-35fff5a6-daa3-410e-a730-e4e4597d2d7b tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:46.594476 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f813ebe3-8ebd-4c78-aa58-240cc6ba5c68 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:46.611614 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f813ebe3-8ebd-4c78-aa58-240cc6ba5c68 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1725 microversion: 2.1 time: 0.226189 Feb 16 14:27:46.612782 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 142/331] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:46 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1725 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:46.737161 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-35fff5a6-daa3-410e-a730-e4e4597d2d7b tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:46.744903 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-35fff5a6-daa3-410e-a730-e4e4597d2d7b tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967" status: 200 len: 1316 microversion: 2.1 time: 0.199754 Feb 16 14:27:46.745604 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 190/332] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:46 2022] GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967 => generated 1316 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:47.059335 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-4d518dbe-ee21-4311-923c-cfd9cfdad07e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:47.059940 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-4d518dbe-ee21-4311-923c-cfd9cfdad07e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:47.065997 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4d518dbe-ee21-4311-923c-cfd9cfdad07e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:47.066328 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4d518dbe-ee21-4311-923c-cfd9cfdad07e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:47.067310 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4d518dbe-ee21-4311-923c-cfd9cfdad07e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:47.067738 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4d518dbe-ee21-4311-923c-cfd9cfdad07e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:47.277674 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-4d518dbe-ee21-4311-923c-cfd9cfdad07e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:47.287351 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-4d518dbe-ee21-4311-923c-cfd9cfdad07e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:47.289424 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-4d518dbe-ee21-4311-923c-cfd9cfdad07e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:47.290681 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-4d518dbe-ee21-4311-923c-cfd9cfdad07e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1743 microversion: 2.20 time: 0.235415 Feb 16 14:27:47.291405 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 143/333] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:27:47 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1743 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:27:47.495428 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-2c67babd-4d4d-4a66-b617-0871b3780f3d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:27:47.500492 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-2c67babd-4d4d-4a66-b617-0871b3780f3d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:47.505236 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-2c67babd-4d4d-4a66-b617-0871b3780f3d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:47.506467 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-2c67babd-4d4d-4a66-b617-0871b3780f3d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:47.507595 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-2c67babd-4d4d-4a66-b617-0871b3780f3d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:47.508253 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-2c67babd-4d4d-4a66-b617-0871b3780f3d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:47.538750 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.objects.instance [None req-2c67babd-4d4d-4a66-b617-0871b3780f3d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lazy-loading 'flavor' on Instance uuid 05accb7b-6275-4c8e-a18b-69b67bdc1d8d {{(pid=117031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:27:47.629706 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-d2e90892-e92a-4069-83a3-478beed50550 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:47.630316 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-d2e90892-e92a-4069-83a3-478beed50550 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:47.637613 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d2e90892-e92a-4069-83a3-478beed50550 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:47.643308 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d2e90892-e92a-4069-83a3-478beed50550 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:47.643308 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d2e90892-e92a-4069-83a3-478beed50550 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:47.643308 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d2e90892-e92a-4069-83a3-478beed50550 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:47.856874 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d2e90892-e92a-4069-83a3-478beed50550 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:47.867380 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-d2e90892-e92a-4069-83a3-478beed50550 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1725 microversion: 2.1 time: 0.241013 Feb 16 14:27:47.867915 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 144/334] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:47 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1725 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:27:47.874701 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e58b0d68-32de-4a13-b6d7-cf909a5c4f80 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:47.876019 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-e58b0d68-32de-4a13-b6d7-cf909a5c4f80 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: fc5d63f6-7400-4c39-8626-4d580eed9967] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:47.882606 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e58b0d68-32de-4a13-b6d7-cf909a5c4f80 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:47.887365 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e58b0d68-32de-4a13-b6d7-cf909a5c4f80 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:47.887365 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e58b0d68-32de-4a13-b6d7-cf909a5c4f80 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:47.887365 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e58b0d68-32de-4a13-b6d7-cf909a5c4f80 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:48.017106 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-2c67babd-4d4d-4a66-b617-0871b3780f3d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "POST /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d/action" status: 200 len: 32 microversion: 2.1 time: 0.524254 Feb 16 14:27:48.022195 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 191/335] 10.222.0.110 () {60 vars in 1282 bytes} [Wed Feb 16 14:27:47 2022] POST /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d/action => generated 32 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 16 14:27:48.043473 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-3009f0a8-02d8-43eb-9ed3-0e12f6cf4ca5 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:48.044521 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-3009f0a8-02d8-43eb-9ed3-0e12f6cf4ca5 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:48.053570 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3009f0a8-02d8-43eb-9ed3-0e12f6cf4ca5 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:48.054286 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3009f0a8-02d8-43eb-9ed3-0e12f6cf4ca5 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:48.055483 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3009f0a8-02d8-43eb-9ed3-0e12f6cf4ca5 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:48.063724 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-e58b0d68-32de-4a13-b6d7-cf909a5c4f80 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:48.065501 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3009f0a8-02d8-43eb-9ed3-0e12f6cf4ca5 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:48.078407 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-e58b0d68-32de-4a13-b6d7-cf909a5c4f80 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967" status: 200 len: 1316 microversion: 2.1 time: 0.209020 Feb 16 14:27:48.079327 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 145/336] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:47 2022] GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967 => generated 1316 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:48.258693 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-3009f0a8-02d8-43eb-9ed3-0e12f6cf4ca5 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:48.287630 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-3009f0a8-02d8-43eb-9ed3-0e12f6cf4ca5 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1571 microversion: 2.1 time: 0.249005 Feb 16 14:27:48.300734 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 192/337] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:48 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1571 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:27:48.312734 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ff227b18-9d39-48c0-9678-b3d594e5e555 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:48.312734 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ff227b18-9d39-48c0-9678-b3d594e5e555 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:48.330215 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ff227b18-9d39-48c0-9678-b3d594e5e555 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:48.331020 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ff227b18-9d39-48c0-9678-b3d594e5e555 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:48.332011 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ff227b18-9d39-48c0-9678-b3d594e5e555 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:48.332592 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ff227b18-9d39-48c0-9678-b3d594e5e555 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:48.684566 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ff227b18-9d39-48c0-9678-b3d594e5e555 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:48.694311 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ff227b18-9d39-48c0-9678-b3d594e5e555 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:48.703005 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ff227b18-9d39-48c0-9678-b3d594e5e555 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:48.704485 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ff227b18-9d39-48c0-9678-b3d594e5e555 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1743 microversion: 2.20 time: 0.398202 Feb 16 14:27:48.715514 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 146/338] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:27:48 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1743 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:27:48.776953 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-53fe9e68-1d83-4e81-b9b7-f152435c49b5 req-a56f6b61-bc40-4d6c-a14b-4febb1ec9168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc5d63f6-7400-4c39-8626-4d580eed9967", "name": "network-vif-plugged", "status": "completed", "tag": "07087be6-f536-403f-9dc7-85cd0f4feb23"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:27:48.779296 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:27:48.779296 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:27:48.790326 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-53fe9e68-1d83-4e81-b9b7-f152435c49b5 req-a56f6b61-bc40-4d6c-a14b-4febb1ec9168 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:48.796468 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-53fe9e68-1d83-4e81-b9b7-f152435c49b5 req-a56f6b61-bc40-4d6c-a14b-4febb1ec9168 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:48.814737 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-53fe9e68-1d83-4e81-b9b7-f152435c49b5 req-a56f6b61-bc40-4d6c-a14b-4febb1ec9168 service nova] Creating event network-vif-plugged:07087be6-f536-403f-9dc7-85cd0f4feb23 for instance fc5d63f6-7400-4c39-8626-4d580eed9967 on hv-cinder-80473 Feb 16 14:27:48.820516 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-53fe9e68-1d83-4e81-b9b7-f152435c49b5 req-a56f6b61-bc40-4d6c-a14b-4febb1ec9168 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047568 Feb 16 14:27:48.825024 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 193/339] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 14:27:48.886512 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-20ef2c36-b2a8-47fb-9c20-d5e58586369f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:48.887944 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-20ef2c36-b2a8-47fb-9c20-d5e58586369f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:48.899966 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-20ef2c36-b2a8-47fb-9c20-d5e58586369f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:48.900723 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-20ef2c36-b2a8-47fb-9c20-d5e58586369f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:48.904052 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-20ef2c36-b2a8-47fb-9c20-d5e58586369f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:48.904907 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-20ef2c36-b2a8-47fb-9c20-d5e58586369f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:49.097082 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-87f92223-dcec-499c-89f2-e0afdf46a93b tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:49.097778 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-87f92223-dcec-499c-89f2-e0afdf46a93b tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: fc5d63f6-7400-4c39-8626-4d580eed9967] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:49.106074 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-87f92223-dcec-499c-89f2-e0afdf46a93b tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:49.106805 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-87f92223-dcec-499c-89f2-e0afdf46a93b tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:49.108172 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-87f92223-dcec-499c-89f2-e0afdf46a93b tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:49.110030 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-87f92223-dcec-499c-89f2-e0afdf46a93b tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:49.174563 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-20ef2c36-b2a8-47fb-9c20-d5e58586369f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:49.183773 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-20ef2c36-b2a8-47fb-9c20-d5e58586369f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1725 microversion: 2.1 time: 0.302147 Feb 16 14:27:49.186753 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 147/340] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:48 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1725 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:49.276434 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-87f92223-dcec-499c-89f2-e0afdf46a93b tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:49.284912 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-87f92223-dcec-499c-89f2-e0afdf46a93b tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967" status: 200 len: 1316 microversion: 2.1 time: 0.192870 Feb 16 14:27:49.285477 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 194/341] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:49 2022] GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967 => generated 1316 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:49.307188 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-dce28688-e9bc-4b0e-a2f3-431930a00054 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:49.307857 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-dce28688-e9bc-4b0e-a2f3-431930a00054 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:49.314683 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dce28688-e9bc-4b0e-a2f3-431930a00054 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:49.315026 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dce28688-e9bc-4b0e-a2f3-431930a00054 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:49.315831 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dce28688-e9bc-4b0e-a2f3-431930a00054 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:49.316401 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dce28688-e9bc-4b0e-a2f3-431930a00054 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:49.578544 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-dce28688-e9bc-4b0e-a2f3-431930a00054 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:49.587075 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-dce28688-e9bc-4b0e-a2f3-431930a00054 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1571 microversion: 2.1 time: 0.283756 Feb 16 14:27:49.587833 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 148/342] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:49 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1571 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:49.723844 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-427d31de-0e00-4a12-86ac-91acea1930e0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:49.724478 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-427d31de-0e00-4a12-86ac-91acea1930e0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:49.730667 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-427d31de-0e00-4a12-86ac-91acea1930e0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:49.731149 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-427d31de-0e00-4a12-86ac-91acea1930e0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:49.732243 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-427d31de-0e00-4a12-86ac-91acea1930e0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:49.732694 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-427d31de-0e00-4a12-86ac-91acea1930e0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:49.881835 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-427d31de-0e00-4a12-86ac-91acea1930e0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:49.892769 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-427d31de-0e00-4a12-86ac-91acea1930e0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:49.897572 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-427d31de-0e00-4a12-86ac-91acea1930e0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:49.899021 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-427d31de-0e00-4a12-86ac-91acea1930e0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1743 microversion: 2.20 time: 0.179106 Feb 16 14:27:49.899843 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 195/343] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:27:49 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1743 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:27:50.200439 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-24b7034a-0574-4a6c-acd5-faf8758629a5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:50.201093 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-24b7034a-0574-4a6c-acd5-faf8758629a5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:50.216942 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-24b7034a-0574-4a6c-acd5-faf8758629a5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:50.220843 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-24b7034a-0574-4a6c-acd5-faf8758629a5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:50.220843 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-24b7034a-0574-4a6c-acd5-faf8758629a5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:50.220843 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-24b7034a-0574-4a6c-acd5-faf8758629a5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:50.304951 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-417f734f-84ce-4537-9259-47138b77dd14 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:50.305818 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-417f734f-84ce-4537-9259-47138b77dd14 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: fc5d63f6-7400-4c39-8626-4d580eed9967] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:50.321558 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-417f734f-84ce-4537-9259-47138b77dd14 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:50.322014 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-417f734f-84ce-4537-9259-47138b77dd14 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:50.322837 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-417f734f-84ce-4537-9259-47138b77dd14 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:50.323260 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-417f734f-84ce-4537-9259-47138b77dd14 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:50.438086 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-24b7034a-0574-4a6c-acd5-faf8758629a5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:50.446402 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-24b7034a-0574-4a6c-acd5-faf8758629a5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1725 microversion: 2.1 time: 0.249665 Feb 16 14:27:50.458368 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 149/344] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:50 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1725 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:50.535913 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-417f734f-84ce-4537-9259-47138b77dd14 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:50.543417 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-417f734f-84ce-4537-9259-47138b77dd14 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967" status: 200 len: 1316 microversion: 2.1 time: 0.242046 Feb 16 14:27:50.544552 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 196/345] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:50 2022] GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967 => generated 1316 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:50.604207 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-647274d0-6376-4fde-af57-c2706790924e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:50.604828 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-647274d0-6376-4fde-af57-c2706790924e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:50.612121 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-647274d0-6376-4fde-af57-c2706790924e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:50.612974 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-647274d0-6376-4fde-af57-c2706790924e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:50.613371 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-647274d0-6376-4fde-af57-c2706790924e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:50.613832 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-647274d0-6376-4fde-af57-c2706790924e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:50.767187 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-647274d0-6376-4fde-af57-c2706790924e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:50.775917 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-647274d0-6376-4fde-af57-c2706790924e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1571 microversion: 2.1 time: 0.175616 Feb 16 14:27:50.776491 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 150/346] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:50 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1571 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:50.923895 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-0a45f601-0d11-4687-942c-c76d511e62f4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:50.924461 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-0a45f601-0d11-4687-942c-c76d511e62f4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:50.930161 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0a45f601-0d11-4687-942c-c76d511e62f4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:50.930615 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0a45f601-0d11-4687-942c-c76d511e62f4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:50.931427 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0a45f601-0d11-4687-942c-c76d511e62f4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:50.931860 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0a45f601-0d11-4687-942c-c76d511e62f4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:51.065673 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-0a45f601-0d11-4687-942c-c76d511e62f4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:51.073508 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-0a45f601-0d11-4687-942c-c76d511e62f4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:51.075632 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-0a45f601-0d11-4687-942c-c76d511e62f4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:51.076259 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-0a45f601-0d11-4687-942c-c76d511e62f4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1743 microversion: 2.20 time: 0.156795 Feb 16 14:27:51.076823 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 197/347] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:27:50 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:27:51.479970 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-dc4a6230-b7bc-4c9e-bf42-9db17660c8bc tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:51.481275 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-dc4a6230-b7bc-4c9e-bf42-9db17660c8bc tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:51.488792 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dc4a6230-b7bc-4c9e-bf42-9db17660c8bc tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:51.489347 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dc4a6230-b7bc-4c9e-bf42-9db17660c8bc tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:51.490237 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dc4a6230-b7bc-4c9e-bf42-9db17660c8bc tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:51.491018 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dc4a6230-b7bc-4c9e-bf42-9db17660c8bc tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:51.560180 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-e57e8487-93d6-44b7-a0ed-105b167fd65d tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:51.560787 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-e57e8487-93d6-44b7-a0ed-105b167fd65d tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: fc5d63f6-7400-4c39-8626-4d580eed9967] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:51.571633 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e57e8487-93d6-44b7-a0ed-105b167fd65d tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:51.572350 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e57e8487-93d6-44b7-a0ed-105b167fd65d tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:51.573397 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e57e8487-93d6-44b7-a0ed-105b167fd65d tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:51.574222 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e57e8487-93d6-44b7-a0ed-105b167fd65d tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:51.723878 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-dc4a6230-b7bc-4c9e-bf42-9db17660c8bc tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:51.737036 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-dc4a6230-b7bc-4c9e-bf42-9db17660c8bc tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1725 microversion: 2.1 time: 0.264732 Feb 16 14:27:51.741307 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 151/348] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:51 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1725 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:51.766390 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-e57e8487-93d6-44b7-a0ed-105b167fd65d tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:51.774083 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-e57e8487-93d6-44b7-a0ed-105b167fd65d tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967" status: 200 len: 1316 microversion: 2.1 time: 0.217461 Feb 16 14:27:51.775256 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 198/349] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:51 2022] GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967 => generated 1316 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:51.795477 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-24a8a9f7-75d2-4920-bcdc-6a27753e4302 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:51.796131 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-24a8a9f7-75d2-4920-bcdc-6a27753e4302 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:51.802826 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-24a8a9f7-75d2-4920-bcdc-6a27753e4302 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:51.803285 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-24a8a9f7-75d2-4920-bcdc-6a27753e4302 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:51.804094 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-24a8a9f7-75d2-4920-bcdc-6a27753e4302 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:51.804533 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-24a8a9f7-75d2-4920-bcdc-6a27753e4302 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:51.975307 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-24a8a9f7-75d2-4920-bcdc-6a27753e4302 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:51.984030 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-24a8a9f7-75d2-4920-bcdc-6a27753e4302 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1571 microversion: 2.1 time: 0.194068 Feb 16 14:27:51.984725 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 152/350] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:51 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1571 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:52.095745 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-129ce4e4-2a10-44dd-9cf8-bfbdba6fd7fc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:52.097197 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-129ce4e4-2a10-44dd-9cf8-bfbdba6fd7fc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:52.104050 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-129ce4e4-2a10-44dd-9cf8-bfbdba6fd7fc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:52.104782 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-129ce4e4-2a10-44dd-9cf8-bfbdba6fd7fc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:52.105567 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-129ce4e4-2a10-44dd-9cf8-bfbdba6fd7fc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:52.106319 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-129ce4e4-2a10-44dd-9cf8-bfbdba6fd7fc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:52.253653 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-129ce4e4-2a10-44dd-9cf8-bfbdba6fd7fc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:52.263819 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-129ce4e4-2a10-44dd-9cf8-bfbdba6fd7fc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:52.266069 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-129ce4e4-2a10-44dd-9cf8-bfbdba6fd7fc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:52.267260 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-129ce4e4-2a10-44dd-9cf8-bfbdba6fd7fc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1743 microversion: 2.20 time: 0.177181 Feb 16 14:27:52.268355 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 199/351] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:27:52 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1743 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:27:52.756906 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e4351316-0f49-4d93-a6bb-b2193cd55fe7 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:52.758447 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-e4351316-0f49-4d93-a6bb-b2193cd55fe7 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:52.764435 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e4351316-0f49-4d93-a6bb-b2193cd55fe7 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:52.765132 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e4351316-0f49-4d93-a6bb-b2193cd55fe7 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:52.765941 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e4351316-0f49-4d93-a6bb-b2193cd55fe7 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:52.766393 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e4351316-0f49-4d93-a6bb-b2193cd55fe7 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:52.795170 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-dd9601f2-4dbd-4307-97d8-be4e12f68f01 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:52.802719 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-dd9601f2-4dbd-4307-97d8-be4e12f68f01 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: fc5d63f6-7400-4c39-8626-4d580eed9967] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:52.803808 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-dd9601f2-4dbd-4307-97d8-be4e12f68f01 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:52.804286 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-dd9601f2-4dbd-4307-97d8-be4e12f68f01 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:52.805315 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-dd9601f2-4dbd-4307-97d8-be4e12f68f01 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:52.805769 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-dd9601f2-4dbd-4307-97d8-be4e12f68f01 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:52.928923 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-e4351316-0f49-4d93-a6bb-b2193cd55fe7 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:52.941298 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-e4351316-0f49-4d93-a6bb-b2193cd55fe7 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1725 microversion: 2.1 time: 0.186628 Feb 16 14:27:52.950617 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 153/352] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:52 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:53.003922 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-802c2c3c-56e7-4d27-94d6-a3d2fd25ab28 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:53.003922 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-802c2c3c-56e7-4d27-94d6-a3d2fd25ab28 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:53.014319 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-802c2c3c-56e7-4d27-94d6-a3d2fd25ab28 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:53.018499 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-802c2c3c-56e7-4d27-94d6-a3d2fd25ab28 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:53.019153 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-dd9601f2-4dbd-4307-97d8-be4e12f68f01 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:53.019548 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-802c2c3c-56e7-4d27-94d6-a3d2fd25ab28 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:53.020036 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-802c2c3c-56e7-4d27-94d6-a3d2fd25ab28 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:53.028477 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-dd9601f2-4dbd-4307-97d8-be4e12f68f01 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967" status: 200 len: 1499 microversion: 2.1 time: 0.237062 Feb 16 14:27:53.039202 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 200/353] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:52 2022] GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967 => generated 1499 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:53.180286 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-802c2c3c-56e7-4d27-94d6-a3d2fd25ab28 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:53.188741 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-802c2c3c-56e7-4d27-94d6-a3d2fd25ab28 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1571 microversion: 2.1 time: 0.191762 Feb 16 14:27:53.189373 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 154/354] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:52 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1571 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:53.285741 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-bc21c431-cfc1-45f6-9b8e-97cca9ee3caf tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:53.286347 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-bc21c431-cfc1-45f6-9b8e-97cca9ee3caf tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:53.292351 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-bc21c431-cfc1-45f6-9b8e-97cca9ee3caf tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:53.292795 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-bc21c431-cfc1-45f6-9b8e-97cca9ee3caf tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:53.293563 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-bc21c431-cfc1-45f6-9b8e-97cca9ee3caf tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:53.293989 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-bc21c431-cfc1-45f6-9b8e-97cca9ee3caf tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:53.432324 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-bc21c431-cfc1-45f6-9b8e-97cca9ee3caf tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:53.441480 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-bc21c431-cfc1-45f6-9b8e-97cca9ee3caf tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:53.447082 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-bc21c431-cfc1-45f6-9b8e-97cca9ee3caf tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:53.447082 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-bc21c431-cfc1-45f6-9b8e-97cca9ee3caf tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1743 microversion: 2.20 time: 0.162044 Feb 16 14:27:53.447082 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 201/355] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:27:53 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1743 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:27:53.958356 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c6c137f2-e253-4f5a-ba53-70f8f67b1a7e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:53.959086 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c6c137f2-e253-4f5a-ba53-70f8f67b1a7e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:53.968431 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c6c137f2-e253-4f5a-ba53-70f8f67b1a7e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:53.971211 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c6c137f2-e253-4f5a-ba53-70f8f67b1a7e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:53.972785 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c6c137f2-e253-4f5a-ba53-70f8f67b1a7e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:53.976022 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c6c137f2-e253-4f5a-ba53-70f8f67b1a7e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:54.166780 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c6c137f2-e253-4f5a-ba53-70f8f67b1a7e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:54.180835 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c6c137f2-e253-4f5a-ba53-70f8f67b1a7e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1702 microversion: 2.1 time: 0.226563 Feb 16 14:27:54.181793 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 155/356] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:53 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1702 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:54.197863 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-e6a1a0ff-957e-4b70-ba5f-32d041de3160 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:27:54.207206 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-866892fd-e35c-40d3-b6fb-97b009de8d84 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:54.207824 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-866892fd-e35c-40d3-b6fb-97b009de8d84 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:54.211575 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e6a1a0ff-957e-4b70-ba5f-32d041de3160 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:54.213933 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e6a1a0ff-957e-4b70-ba5f-32d041de3160 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:54.221933 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-866892fd-e35c-40d3-b6fb-97b009de8d84 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:54.224855 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-866892fd-e35c-40d3-b6fb-97b009de8d84 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:54.224855 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-866892fd-e35c-40d3-b6fb-97b009de8d84 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:54.224855 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-866892fd-e35c-40d3-b6fb-97b009de8d84 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:54.257463 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-e6a1a0ff-957e-4b70-ba5f-32d041de3160 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Going to try to start instance {{(pid=117031) start /opt/stack/nova/nova/compute/api.py:2677}} Feb 16 14:27:54.450786 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-866892fd-e35c-40d3-b6fb-97b009de8d84 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:54.463237 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-866892fd-e35c-40d3-b6fb-97b009de8d84 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1571 microversion: 2.1 time: 0.261601 Feb 16 14:27:54.464475 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 156/357] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:54 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1571 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:54.469806 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-eaf05781-197c-4bfe-81e6-f22c8f01479b tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:54.470522 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-eaf05781-197c-4bfe-81e6-f22c8f01479b tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: fc5d63f6-7400-4c39-8626-4d580eed9967] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:54.481086 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-eaf05781-197c-4bfe-81e6-f22c8f01479b tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:54.481739 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-eaf05781-197c-4bfe-81e6-f22c8f01479b tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:54.482688 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-eaf05781-197c-4bfe-81e6-f22c8f01479b tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:54.483196 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-eaf05781-197c-4bfe-81e6-f22c8f01479b tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:54.515886 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-eaf05781-197c-4bfe-81e6-f22c8f01479b tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: fc5d63f6-7400-4c39-8626-4d580eed9967] Going to try to terminate instance {{(pid=117032) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 16 14:27:54.767634 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-e6a1a0ff-957e-4b70-ba5f-32d041de3160 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "POST /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35/action" status: 202 len: 0 microversion: 2.1 time: 0.573253 Feb 16 14:27:54.775177 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 202/358] 10.222.0.110 () {60 vars in 1282 bytes} [Wed Feb 16 14:27:54 2022] POST /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35/action => generated 0 bytes in 575 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 14:27:54.775177 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-d854fb66-7d51-4dee-87e9-26da716e0b29 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:54.775177 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-d854fb66-7d51-4dee-87e9-26da716e0b29 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:54.781580 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d854fb66-7d51-4dee-87e9-26da716e0b29 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:54.782036 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d854fb66-7d51-4dee-87e9-26da716e0b29 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:54.782899 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d854fb66-7d51-4dee-87e9-26da716e0b29 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:54.783336 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d854fb66-7d51-4dee-87e9-26da716e0b29 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:54.930024 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-d854fb66-7d51-4dee-87e9-26da716e0b29 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:54.937829 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-d854fb66-7d51-4dee-87e9-26da716e0b29 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:54.939439 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-d854fb66-7d51-4dee-87e9-26da716e0b29 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:54.940886 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-d854fb66-7d51-4dee-87e9-26da716e0b29 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1743 microversion: 2.20 time: 0.171284 Feb 16 14:27:54.941165 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 203/359] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:27:54 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1743 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:27:54.945598 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-842fdbac-6d0d-4a45-8906-fa6c9cc6ab5b tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:54.946009 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-842fdbac-6d0d-4a45-8906-fa6c9cc6ab5b tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:54.951977 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-842fdbac-6d0d-4a45-8906-fa6c9cc6ab5b tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:54.952500 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-842fdbac-6d0d-4a45-8906-fa6c9cc6ab5b tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:54.953273 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-842fdbac-6d0d-4a45-8906-fa6c9cc6ab5b tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:54.954001 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-842fdbac-6d0d-4a45-8906-fa6c9cc6ab5b tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:55.171830 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-eaf05781-197c-4bfe-81e6-f22c8f01479b tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "DELETE /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967" status: 204 len: 0 microversion: 2.1 time: 0.704614 Feb 16 14:27:55.173414 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 157/360] 10.222.0.110 () {58 vars in 1243 bytes} [Wed Feb 16 14:27:54 2022] DELETE /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967 => generated 0 bytes in 708 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 16 14:27:55.183641 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-68155f9b-034d-4c6e-ae14-5a6825bcfa68 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:55.184692 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-68155f9b-034d-4c6e-ae14-5a6825bcfa68 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: fc5d63f6-7400-4c39-8626-4d580eed9967] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:55.191251 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-68155f9b-034d-4c6e-ae14-5a6825bcfa68 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:55.192031 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-68155f9b-034d-4c6e-ae14-5a6825bcfa68 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:55.193047 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-68155f9b-034d-4c6e-ae14-5a6825bcfa68 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:55.193701 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-68155f9b-034d-4c6e-ae14-5a6825bcfa68 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:55.200489 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-842fdbac-6d0d-4a45-8906-fa6c9cc6ab5b tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:55.210880 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-842fdbac-6d0d-4a45-8906-fa6c9cc6ab5b tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1711 microversion: 2.1 time: 0.268487 Feb 16 14:27:55.211773 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 204/361] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:54 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1711 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:55.479759 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-43ca6cf1-5cca-4743-97d9-b542a827119b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:55.480441 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-43ca6cf1-5cca-4743-97d9-b542a827119b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:55.493603 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-43ca6cf1-5cca-4743-97d9-b542a827119b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:55.495752 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-43ca6cf1-5cca-4743-97d9-b542a827119b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:55.495752 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-43ca6cf1-5cca-4743-97d9-b542a827119b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:55.497102 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-43ca6cf1-5cca-4743-97d9-b542a827119b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:55.653721 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-43ca6cf1-5cca-4743-97d9-b542a827119b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:55.666573 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-43ca6cf1-5cca-4743-97d9-b542a827119b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1571 microversion: 2.1 time: 0.190524 Feb 16 14:27:55.667895 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 205/362] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:55 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1571 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:55.689334 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-68155f9b-034d-4c6e-ae14-5a6825bcfa68 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:55.700192 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-68155f9b-034d-4c6e-ae14-5a6825bcfa68 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967" status: 200 len: 1505 microversion: 2.1 time: 0.520953 Feb 16 14:27:55.702795 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 158/363] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:55 2022] GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967 => generated 1505 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:27:55.958871 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-15c53ba6-ef96-48ca-afa1-6841e9917ea1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:55.960057 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-15c53ba6-ef96-48ca-afa1-6841e9917ea1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:55.966754 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-15c53ba6-ef96-48ca-afa1-6841e9917ea1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:55.967431 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-15c53ba6-ef96-48ca-afa1-6841e9917ea1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:55.968930 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-15c53ba6-ef96-48ca-afa1-6841e9917ea1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:55.969515 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-15c53ba6-ef96-48ca-afa1-6841e9917ea1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:56.156724 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-15c53ba6-ef96-48ca-afa1-6841e9917ea1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:56.166025 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-15c53ba6-ef96-48ca-afa1-6841e9917ea1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:56.167801 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-15c53ba6-ef96-48ca-afa1-6841e9917ea1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:56.169399 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-15c53ba6-ef96-48ca-afa1-6841e9917ea1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1743 microversion: 2.20 time: 0.214159 Feb 16 14:27:56.170114 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 206/364] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:27:55 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1743 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:27:56.206705 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-be339d12-f802-4ea0-ab60-3cb2b1063ce6 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "84155849-517c-4aba-8717-258f03a16f17", "device": "/dev/sdb"}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:27:56.208586 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-be339d12-f802-4ea0-ab60-3cb2b1063ce6 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: d86c93ea-a9ad-4b0c-bc25-18f3da5bb813] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:56.215557 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-be339d12-f802-4ea0-ab60-3cb2b1063ce6 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:56.216218 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-be339d12-f802-4ea0-ab60-3cb2b1063ce6 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:56.217225 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-be339d12-f802-4ea0-ab60-3cb2b1063ce6 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:56.217714 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-be339d12-f802-4ea0-ab60-3cb2b1063ce6 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:56.230682 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-a817c019-1cee-4e56-a913-fa6c683d76d5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:56.231460 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-a817c019-1cee-4e56-a913-fa6c683d76d5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:56.239732 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a817c019-1cee-4e56-a913-fa6c683d76d5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:56.240459 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a817c019-1cee-4e56-a913-fa6c683d76d5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:56.241757 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a817c019-1cee-4e56-a913-fa6c683d76d5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:56.242610 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a817c019-1cee-4e56-a913-fa6c683d76d5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:56.429834 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-a817c019-1cee-4e56-a913-fa6c683d76d5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:56.439922 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-a817c019-1cee-4e56-a913-fa6c683d76d5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1711 microversion: 2.1 time: 0.213525 Feb 16 14:27:56.448106 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 207/365] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:56 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1711 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:56.693254 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-d5f9d66a-53ba-4d5c-ab83-14eb4b7b0f5f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:56.693946 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-d5f9d66a-53ba-4d5c-ab83-14eb4b7b0f5f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:56.701949 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d5f9d66a-53ba-4d5c-ab83-14eb4b7b0f5f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:56.708067 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d5f9d66a-53ba-4d5c-ab83-14eb4b7b0f5f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:56.709184 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d5f9d66a-53ba-4d5c-ab83-14eb4b7b0f5f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:56.712665 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d5f9d66a-53ba-4d5c-ab83-14eb4b7b0f5f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:56.926424 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-d5f9d66a-53ba-4d5c-ab83-14eb4b7b0f5f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:56.935336 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-d5f9d66a-53ba-4d5c-ab83-14eb4b7b0f5f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1571 microversion: 2.1 time: 0.254790 Feb 16 14:27:56.939095 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 208/366] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:56 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1571 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:56.951522 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-0db0184c-c94f-4e9c-9b47-89143a327afd tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:56.952346 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-0db0184c-c94f-4e9c-9b47-89143a327afd tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: fc5d63f6-7400-4c39-8626-4d580eed9967] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:56.960202 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0db0184c-c94f-4e9c-9b47-89143a327afd tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:56.961368 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0db0184c-c94f-4e9c-9b47-89143a327afd tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:56.962437 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0db0184c-c94f-4e9c-9b47-89143a327afd tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:56.963092 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0db0184c-c94f-4e9c-9b47-89143a327afd tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:57.141402 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-be339d12-f802-4ea0-ab60-3cb2b1063ce6 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "POST /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.939220 Feb 16 14:27:57.143054 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 159/367] 10.222.0.110 () {60 vars in 1327 bytes} [Wed Feb 16 14:27:56 2022] POST /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813/os-volume_attachments => generated 194 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:27:57.158759 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-0db0184c-c94f-4e9c-9b47-89143a327afd tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:57.169767 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-0db0184c-c94f-4e9c-9b47-89143a327afd tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967" status: 200 len: 1505 microversion: 2.1 time: 0.229436 Feb 16 14:27:57.170653 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 209/368] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:56 2022] GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967 => generated 1505 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:57.205230 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-29e6e292-fa5f-4133-bfcf-6a4c1e8037e2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:57.212518 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-29e6e292-fa5f-4133-bfcf-6a4c1e8037e2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:57.226222 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-29e6e292-fa5f-4133-bfcf-6a4c1e8037e2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:57.226745 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-29e6e292-fa5f-4133-bfcf-6a4c1e8037e2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:57.227478 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-29e6e292-fa5f-4133-bfcf-6a4c1e8037e2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:57.228017 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-29e6e292-fa5f-4133-bfcf-6a4c1e8037e2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:57.458243 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-8d38df2f-2d95-4df4-bbff-957071041ac0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:57.459153 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-8d38df2f-2d95-4df4-bbff-957071041ac0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:57.472551 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8d38df2f-2d95-4df4-bbff-957071041ac0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:57.476662 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8d38df2f-2d95-4df4-bbff-957071041ac0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:57.476809 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8d38df2f-2d95-4df4-bbff-957071041ac0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:57.477458 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8d38df2f-2d95-4df4-bbff-957071041ac0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:57.535392 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-29e6e292-fa5f-4133-bfcf-6a4c1e8037e2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:57.544489 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-29e6e292-fa5f-4133-bfcf-6a4c1e8037e2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:57.550935 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-29e6e292-fa5f-4133-bfcf-6a4c1e8037e2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:57.550935 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-29e6e292-fa5f-4133-bfcf-6a4c1e8037e2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1743 microversion: 2.20 time: 0.353503 Feb 16 14:27:57.553328 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 160/369] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:27:57 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1743 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:27:57.761444 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-8d38df2f-2d95-4df4-bbff-957071041ac0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:57.771220 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-8d38df2f-2d95-4df4-bbff-957071041ac0 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1711 microversion: 2.1 time: 0.316989 Feb 16 14:27:57.781873 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 210/370] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:57 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1711 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:27:57.959804 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-8542c9c9-31ee-4121-8f90-8afbce4769aa tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:57.960617 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-8542c9c9-31ee-4121-8f90-8afbce4769aa tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:57.967962 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8542c9c9-31ee-4121-8f90-8afbce4769aa tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:57.969307 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8542c9c9-31ee-4121-8f90-8afbce4769aa tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:57.970399 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8542c9c9-31ee-4121-8f90-8afbce4769aa tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:57.970870 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8542c9c9-31ee-4121-8f90-8afbce4769aa tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:58.188105 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-1070abed-131f-47fb-af30-955218223ee4 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:58.189647 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-1070abed-131f-47fb-af30-955218223ee4 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: fc5d63f6-7400-4c39-8626-4d580eed9967] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:58.197591 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1070abed-131f-47fb-af30-955218223ee4 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:58.198037 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1070abed-131f-47fb-af30-955218223ee4 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:58.200526 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1070abed-131f-47fb-af30-955218223ee4 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:58.201143 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1070abed-131f-47fb-af30-955218223ee4 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:58.224238 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-8542c9c9-31ee-4121-8f90-8afbce4769aa tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:58.232520 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-8542c9c9-31ee-4121-8f90-8afbce4769aa tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1571 microversion: 2.1 time: 0.276824 Feb 16 14:27:58.258229 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 161/371] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:57 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1571 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:58.341279 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-1070abed-131f-47fb-af30-955218223ee4 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:58.353435 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-1070abed-131f-47fb-af30-955218223ee4 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967" status: 200 len: 1463 microversion: 2.1 time: 0.169176 Feb 16 14:27:58.367010 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 211/372] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:58 2022] GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967 => generated 1463 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:27:58.446392 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-7d8971b5-bd37-4da3-bcff-de1d4e39a14e req-1dae9dad-23f4-4dc4-a18f-a1615c9b88f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc5d63f6-7400-4c39-8626-4d580eed9967", "name": "network-vif-deleted", "tag": "07087be6-f536-403f-9dc7-85cd0f4feb23"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:27:58.448159 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:27:58.448159 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: warnings.warn(msg) Feb 16 14:27:58.457520 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-7d8971b5-bd37-4da3-bcff-de1d4e39a14e req-1dae9dad-23f4-4dc4-a18f-a1615c9b88f2 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:58.458208 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-7d8971b5-bd37-4da3-bcff-de1d4e39a14e req-1dae9dad-23f4-4dc4-a18f-a1615c9b88f2 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:58.476494 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-7d8971b5-bd37-4da3-bcff-de1d4e39a14e req-1dae9dad-23f4-4dc4-a18f-a1615c9b88f2 service nova] Creating event network-vif-deleted:07087be6-f536-403f-9dc7-85cd0f4feb23 for instance fc5d63f6-7400-4c39-8626-4d580eed9967 on hv-cinder-80473 Feb 16 14:27:58.485773 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-7d8971b5-bd37-4da3-bcff-de1d4e39a14e req-1dae9dad-23f4-4dc4-a18f-a1615c9b88f2 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042583 Feb 16 14:27:58.487218 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 162/373] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:27:58.588825 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-0feb14d7-9f7c-4ffb-977c-24a40bc7926d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:58.599712 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-0feb14d7-9f7c-4ffb-977c-24a40bc7926d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:58.606110 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0feb14d7-9f7c-4ffb-977c-24a40bc7926d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:58.607103 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0feb14d7-9f7c-4ffb-977c-24a40bc7926d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:58.608240 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0feb14d7-9f7c-4ffb-977c-24a40bc7926d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:58.609203 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0feb14d7-9f7c-4ffb-977c-24a40bc7926d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:58.781769 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-0feb14d7-9f7c-4ffb-977c-24a40bc7926d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:58.790013 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-0feb14d7-9f7c-4ffb-977c-24a40bc7926d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:58.790351 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-458c9e2a-7263-4676-85d1-b1f4fab33b99 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:58.791088 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-458c9e2a-7263-4676-85d1-b1f4fab33b99 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:58.791566 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-0feb14d7-9f7c-4ffb-977c-24a40bc7926d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:58.792759 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-0feb14d7-9f7c-4ffb-977c-24a40bc7926d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1743 microversion: 2.20 time: 0.211323 Feb 16 14:27:58.793553 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 212/374] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:27:58 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1743 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:27:58.798271 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-458c9e2a-7263-4676-85d1-b1f4fab33b99 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:58.799252 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-458c9e2a-7263-4676-85d1-b1f4fab33b99 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:58.799585 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-458c9e2a-7263-4676-85d1-b1f4fab33b99 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:58.800031 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-458c9e2a-7263-4676-85d1-b1f4fab33b99 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:58.971154 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-458c9e2a-7263-4676-85d1-b1f4fab33b99 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:58.979002 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-458c9e2a-7263-4676-85d1-b1f4fab33b99 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1715 microversion: 2.1 time: 0.193026 Feb 16 14:27:58.979577 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 163/375] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:58 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1715 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:27:59.274583 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-2fb7b2c9-f12d-435b-8366-467a6aff550d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:59.275224 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-2fb7b2c9-f12d-435b-8366-467a6aff550d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:59.281948 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-2fb7b2c9-f12d-435b-8366-467a6aff550d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:59.282404 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-2fb7b2c9-f12d-435b-8366-467a6aff550d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:59.283260 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-2fb7b2c9-f12d-435b-8366-467a6aff550d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:59.283656 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-2fb7b2c9-f12d-435b-8366-467a6aff550d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:59.380847 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-063350ae-11ab-4be9-88d5-8d916026194a tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:59.381441 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-063350ae-11ab-4be9-88d5-8d916026194a tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: fc5d63f6-7400-4c39-8626-4d580eed9967] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:59.392839 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-063350ae-11ab-4be9-88d5-8d916026194a tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:59.393304 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-063350ae-11ab-4be9-88d5-8d916026194a tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:59.394155 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-063350ae-11ab-4be9-88d5-8d916026194a tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:59.395279 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-063350ae-11ab-4be9-88d5-8d916026194a tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:59.493273 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-2fb7b2c9-f12d-435b-8366-467a6aff550d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:59.493440 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-063350ae-11ab-4be9-88d5-8d916026194a tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:27:59.508462 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-063350ae-11ab-4be9-88d5-8d916026194a tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967" status: 200 len: 1301 microversion: 2.1 time: 0.135587 Feb 16 14:27:59.509771 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 164/376] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:59 2022] GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967 => generated 1301 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:27:59.526785 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-2fb7b2c9-f12d-435b-8366-467a6aff550d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1571 microversion: 2.1 time: 0.255835 Feb 16 14:27:59.527353 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 213/377] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:27:59 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1571 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:27:59.816041 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c66733a4-ee9b-4875-8eda-96359b61db43 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:27:59.816877 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c66733a4-ee9b-4875-8eda-96359b61db43 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:27:59.823760 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c66733a4-ee9b-4875-8eda-96359b61db43 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:59.824212 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c66733a4-ee9b-4875-8eda-96359b61db43 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:27:59.825142 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c66733a4-ee9b-4875-8eda-96359b61db43 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:27:59.825588 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c66733a4-ee9b-4875-8eda-96359b61db43 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:00.055963 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c66733a4-ee9b-4875-8eda-96359b61db43 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:00.099616 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c66733a4-ee9b-4875-8eda-96359b61db43 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:00.099616 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c66733a4-ee9b-4875-8eda-96359b61db43 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:00.099616 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c66733a4-ee9b-4875-8eda-96359b61db43 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1743 microversion: 2.20 time: 0.285165 Feb 16 14:28:00.101547 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 165/378] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:27:59 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1743 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:28:00.533031 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-8364bef8-9fe0-4bc5-8bc1-8348c248a1c0 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:00.533890 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-8364bef8-9fe0-4bc5-8bc1-8348c248a1c0 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: fc5d63f6-7400-4c39-8626-4d580eed9967] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:00.541197 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8364bef8-9fe0-4bc5-8bc1-8348c248a1c0 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:00.541838 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8364bef8-9fe0-4bc5-8bc1-8348c248a1c0 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:00.542846 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8364bef8-9fe0-4bc5-8bc1-8348c248a1c0 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:00.543433 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8364bef8-9fe0-4bc5-8bc1-8348c248a1c0 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:00.544877 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-35b8699b-011b-47ea-b317-fe8188b68da3 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:00.545653 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-35b8699b-011b-47ea-b317-fe8188b68da3 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:00.552532 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-35b8699b-011b-47ea-b317-fe8188b68da3 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:00.552993 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-35b8699b-011b-47ea-b317-fe8188b68da3 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:00.553786 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-35b8699b-011b-47ea-b317-fe8188b68da3 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:00.554229 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-35b8699b-011b-47ea-b317-fe8188b68da3 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:00.577935 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8364bef8-9fe0-4bc5-8bc1-8348c248a1c0 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:00.578394 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8364bef8-9fe0-4bc5-8bc1-8348c248a1c0 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:00.579271 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.objects.instance [None req-8364bef8-9fe0-4bc5-8bc1-8348c248a1c0 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lazy-loading 'fault' on Instance uuid fc5d63f6-7400-4c39-8626-4d580eed9967 {{(pid=117031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:28:00.631322 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-8364bef8-9fe0-4bc5-8bc1-8348c248a1c0 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:00.638859 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-8364bef8-9fe0-4bc5-8bc1-8348c248a1c0 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967" status: 200 len: 1306 microversion: 2.1 time: 0.110502 Feb 16 14:28:00.643077 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 214/379] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:00 2022] GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967 => generated 1306 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:00.746670 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-35b8699b-011b-47ea-b317-fe8188b68da3 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:00.754787 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-35b8699b-011b-47ea-b317-fe8188b68da3 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1571 microversion: 2.1 time: 0.213443 Feb 16 14:28:00.755454 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 166/380] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:00 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1571 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:28:01.115147 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-6200e654-ff4b-4f98-9db7-95982e835dc6 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:01.115750 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-6200e654-ff4b-4f98-9db7-95982e835dc6 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:01.121715 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-6200e654-ff4b-4f98-9db7-95982e835dc6 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:01.122281 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-6200e654-ff4b-4f98-9db7-95982e835dc6 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:01.123004 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-6200e654-ff4b-4f98-9db7-95982e835dc6 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:01.123432 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-6200e654-ff4b-4f98-9db7-95982e835dc6 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:01.261414 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-6200e654-ff4b-4f98-9db7-95982e835dc6 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:01.270139 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-6200e654-ff4b-4f98-9db7-95982e835dc6 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:01.271681 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-6200e654-ff4b-4f98-9db7-95982e835dc6 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:01.281035 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-6200e654-ff4b-4f98-9db7-95982e835dc6 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1743 microversion: 2.20 time: 0.161450 Feb 16 14:28:01.281035 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 215/381] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:01 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1743 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:28:01.657764 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6c419086-8341-4769-9ff2-2a89ed845b34 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:01.658500 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-6c419086-8341-4769-9ff2-2a89ed845b34 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: fc5d63f6-7400-4c39-8626-4d580eed9967] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:01.666417 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6c419086-8341-4769-9ff2-2a89ed845b34 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:01.666857 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6c419086-8341-4769-9ff2-2a89ed845b34 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:01.667643 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6c419086-8341-4769-9ff2-2a89ed845b34 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:01.668080 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6c419086-8341-4769-9ff2-2a89ed845b34 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:01.682457 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-6c419086-8341-4769-9ff2-2a89ed845b34 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] HTTP exception thrown: Instance fc5d63f6-7400-4c39-8626-4d580eed9967 could not be found. Feb 16 14:28:01.683072 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6c419086-8341-4769-9ff2-2a89ed845b34 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Returning 404 to user: Instance fc5d63f6-7400-4c39-8626-4d580eed9967 could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:28:01.684062 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-6c419086-8341-4769-9ff2-2a89ed845b34 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967" status: 404 len: 111 microversion: 2.1 time: 0.030561 Feb 16 14:28:01.684774 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 167/382] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:01 2022] GET /compute/v2.1/servers/fc5d63f6-7400-4c39-8626-4d580eed9967 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 14:28:01.773426 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-f79d9859-a295-45dd-9c88-aefbeafc1d16 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:01.776275 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-f79d9859-a295-45dd-9c88-aefbeafc1d16 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:01.781936 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f79d9859-a295-45dd-9c88-aefbeafc1d16 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:01.782712 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f79d9859-a295-45dd-9c88-aefbeafc1d16 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:01.783728 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f79d9859-a295-45dd-9c88-aefbeafc1d16 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:01.784456 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f79d9859-a295-45dd-9c88-aefbeafc1d16 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:01.785400 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-24e554b2-bb27-4736-b602-fb9b6f2c202e tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-850490753", "imageRef": "2493d2dc-e081-43d3-8292-91b4762a21e8", "flavorRef": "452", "networks": [{"uuid": "835d5ce9-a339-46c8-92e9-bdcd224e11f0"}]}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:28:01.838219 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.network.neutron [None req-24e554b2-bb27-4736-b602-fb9b6f2c202e tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] validate_networks() for [('835d5ce9-a339-46c8-92e9-bdcd224e11f0', None, None, None, None, None)] {{(pid=117032) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 16 14:28:01.956078 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-f79d9859-a295-45dd-9c88-aefbeafc1d16 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:01.964373 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-f79d9859-a295-45dd-9c88-aefbeafc1d16 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1571 microversion: 2.1 time: 0.196568 Feb 16 14:28:01.964947 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 216/383] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:01 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1571 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:02.190173 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-24e554b2-bb27-4736-b602-fb9b6f2c202e tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Flavor limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 16 14:28:02.190594 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-24e554b2-bb27-4736-b602-fb9b6f2c202e tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Image limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 16 14:28:02.191095 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-24e554b2-bb27-4736-b602-fb9b6f2c202e tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Flavor pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 16 14:28:02.191541 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-24e554b2-bb27-4736-b602-fb9b6f2c202e tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Image pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 16 14:28:02.191950 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-24e554b2-bb27-4736-b602-fb9b6f2c202e tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 16 14:28:02.201326 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-24e554b2-bb27-4736-b602-fb9b6f2c202e tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:02.201778 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-24e554b2-bb27-4736-b602-fb9b6f2c202e tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:02.203221 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-24e554b2-bb27-4736-b602-fb9b6f2c202e tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:02.203656 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-24e554b2-bb27-4736-b602-fb9b6f2c202e tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:02.220278 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-24e554b2-bb27-4736-b602-fb9b6f2c202e tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Getting quotas for project 3d3028599f374f01812a61120701fb2f. Resources: {'cores', 'instances', 'ram'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 14:28:02.224229 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-24e554b2-bb27-4736-b602-fb9b6f2c202e tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Getting quotas for user 642800fd0f7b4d5faa698f594b493bce and project 3d3028599f374f01812a61120701fb2f. Resources: {'cores', 'instances', 'ram'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 14:28:02.234889 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-24e554b2-bb27-4736-b602-fb9b6f2c202e tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Going to run 1 instances... {{(pid=117032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 16 14:28:02.237204 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-24e554b2-bb27-4736-b602-fb9b6f2c202e tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: 897873de-9c9e-4336-b6c5-4bf241507c91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2493d2dc-e081-43d3-8292-91b4762a21e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 16 14:28:02.291289 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-ca3e63a8-240c-4ab1-99e8-bfeae58e7246 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:02.291893 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-ca3e63a8-240c-4ab1-99e8-bfeae58e7246 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:02.298125 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ca3e63a8-240c-4ab1-99e8-bfeae58e7246 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:02.298594 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ca3e63a8-240c-4ab1-99e8-bfeae58e7246 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:02.299434 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ca3e63a8-240c-4ab1-99e8-bfeae58e7246 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:02.299861 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ca3e63a8-240c-4ab1-99e8-bfeae58e7246 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:02.338226 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-24e554b2-bb27-4736-b602-fb9b6f2c202e tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.556518 Feb 16 14:28:02.344135 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 168/384] 10.222.0.110 () {60 vars in 1151 bytes} [Wed Feb 16 14:28:01 2022] POST /compute/v2.1/servers => generated 382 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Feb 16 14:28:02.349340 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6c26533e-6a79-4616-b432-8a79c668badf tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:02.349965 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-6c26533e-6a79-4616-b432-8a79c668badf tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: 897873de-9c9e-4336-b6c5-4bf241507c91] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:02.408185 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6c26533e-6a79-4616-b432-8a79c668badf tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:02.415811 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-6c26533e-6a79-4616-b432-8a79c668badf tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91" status: 200 len: 1217 microversion: 2.1 time: 0.070368 Feb 16 14:28:02.416562 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 169/385] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:02 2022] GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91 => generated 1217 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:28:02.459612 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-ca3e63a8-240c-4ab1-99e8-bfeae58e7246 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:02.468038 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-ca3e63a8-240c-4ab1-99e8-bfeae58e7246 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:02.469635 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-ca3e63a8-240c-4ab1-99e8-bfeae58e7246 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:02.470895 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-ca3e63a8-240c-4ab1-99e8-bfeae58e7246 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1725 microversion: 2.20 time: 0.183311 Feb 16 14:28:02.471524 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 217/386] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:02 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:28:02.981274 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-9bb16c52-bc86-4f03-be00-3e1b2282171a tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:02.981889 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-9bb16c52-bc86-4f03-be00-3e1b2282171a tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:02.988930 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9bb16c52-bc86-4f03-be00-3e1b2282171a tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:02.989382 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9bb16c52-bc86-4f03-be00-3e1b2282171a tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:02.990168 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9bb16c52-bc86-4f03-be00-3e1b2282171a tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:02.990608 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9bb16c52-bc86-4f03-be00-3e1b2282171a tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:03.124835 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-9bb16c52-bc86-4f03-be00-3e1b2282171a tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:03.132719 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-9bb16c52-bc86-4f03-be00-3e1b2282171a tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1571 microversion: 2.1 time: 0.155092 Feb 16 14:28:03.133347 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 170/387] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:02 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:03.433035 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-c8da4435-65b2-4f74-be95-06bbbecad642 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:03.433638 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-c8da4435-65b2-4f74-be95-06bbbecad642 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: 897873de-9c9e-4336-b6c5-4bf241507c91] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:03.440142 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c8da4435-65b2-4f74-be95-06bbbecad642 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:03.440597 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c8da4435-65b2-4f74-be95-06bbbecad642 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:03.441380 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c8da4435-65b2-4f74-be95-06bbbecad642 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:03.441814 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c8da4435-65b2-4f74-be95-06bbbecad642 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:03.489813 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a232a991-843a-4c56-b454-a796af6c01cb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:03.490470 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a232a991-843a-4c56-b454-a796af6c01cb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:03.496443 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a232a991-843a-4c56-b454-a796af6c01cb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:03.496897 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a232a991-843a-4c56-b454-a796af6c01cb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:03.497689 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a232a991-843a-4c56-b454-a796af6c01cb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:03.498125 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a232a991-843a-4c56-b454-a796af6c01cb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:03.501885 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-c8da4435-65b2-4f74-be95-06bbbecad642 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:03.508966 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-c8da4435-65b2-4f74-be95-06bbbecad642 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91" status: 200 len: 1221 microversion: 2.1 time: 0.079581 Feb 16 14:28:03.509533 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 218/388] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:03 2022] GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91 => generated 1221 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:03.634329 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a232a991-843a-4c56-b454-a796af6c01cb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:03.643137 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a232a991-843a-4c56-b454-a796af6c01cb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:03.644653 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a232a991-843a-4c56-b454-a796af6c01cb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:03.645802 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a232a991-843a-4c56-b454-a796af6c01cb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1725 microversion: 2.20 time: 0.159823 Feb 16 14:28:03.646354 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 171/389] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:03 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:28:04.149457 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-a99c263d-57ee-45c3-8b94-bc228be20d10 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:04.149999 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-a99c263d-57ee-45c3-8b94-bc228be20d10 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:04.155879 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a99c263d-57ee-45c3-8b94-bc228be20d10 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:04.156620 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a99c263d-57ee-45c3-8b94-bc228be20d10 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:04.157406 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a99c263d-57ee-45c3-8b94-bc228be20d10 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:04.157852 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a99c263d-57ee-45c3-8b94-bc228be20d10 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:04.294286 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-a99c263d-57ee-45c3-8b94-bc228be20d10 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:04.303136 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-a99c263d-57ee-45c3-8b94-bc228be20d10 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1571 microversion: 2.1 time: 0.157398 Feb 16 14:28:04.304045 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 219/390] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:04 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1571 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:04.526260 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a0062c0b-a636-4cc9-bd78-ef9fc68fc291 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:04.526905 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a0062c0b-a636-4cc9-bd78-ef9fc68fc291 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: 897873de-9c9e-4336-b6c5-4bf241507c91] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:04.533979 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a0062c0b-a636-4cc9-bd78-ef9fc68fc291 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:04.534432 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a0062c0b-a636-4cc9-bd78-ef9fc68fc291 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:04.535235 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a0062c0b-a636-4cc9-bd78-ef9fc68fc291 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:04.535752 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a0062c0b-a636-4cc9-bd78-ef9fc68fc291 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:04.597836 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a0062c0b-a636-4cc9-bd78-ef9fc68fc291 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:04.604960 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a0062c0b-a636-4cc9-bd78-ef9fc68fc291 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91" status: 200 len: 1213 microversion: 2.1 time: 0.082503 Feb 16 14:28:04.605516 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 172/391] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:04 2022] GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:04.664467 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-b78f8960-71a1-41b3-b40f-a521fcff0c1c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:04.665072 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-b78f8960-71a1-41b3-b40f-a521fcff0c1c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:04.671559 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b78f8960-71a1-41b3-b40f-a521fcff0c1c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:04.672210 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b78f8960-71a1-41b3-b40f-a521fcff0c1c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:04.673019 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b78f8960-71a1-41b3-b40f-a521fcff0c1c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:04.673577 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b78f8960-71a1-41b3-b40f-a521fcff0c1c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:04.808763 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-b78f8960-71a1-41b3-b40f-a521fcff0c1c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:04.816827 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-b78f8960-71a1-41b3-b40f-a521fcff0c1c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:04.818898 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-b78f8960-71a1-41b3-b40f-a521fcff0c1c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:04.820218 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-b78f8960-71a1-41b3-b40f-a521fcff0c1c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1725 microversion: 2.20 time: 0.159490 Feb 16 14:28:04.820780 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 220/392] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:04 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:28:05.320481 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-827634eb-f6e2-42ea-989d-ca9371fd314c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:05.321090 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-827634eb-f6e2-42ea-989d-ca9371fd314c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:05.326902 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-827634eb-f6e2-42ea-989d-ca9371fd314c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:05.327428 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-827634eb-f6e2-42ea-989d-ca9371fd314c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:05.329127 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-827634eb-f6e2-42ea-989d-ca9371fd314c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:05.329565 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-827634eb-f6e2-42ea-989d-ca9371fd314c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:05.473592 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-827634eb-f6e2-42ea-989d-ca9371fd314c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:05.481384 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-827634eb-f6e2-42ea-989d-ca9371fd314c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1571 microversion: 2.1 time: 0.164663 Feb 16 14:28:05.482148 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 173/393] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:05 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1571 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:05.621813 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-aa7a3cdc-f48c-4301-802e-8090fe122245 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:05.622339 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-aa7a3cdc-f48c-4301-802e-8090fe122245 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: 897873de-9c9e-4336-b6c5-4bf241507c91] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:05.628943 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-aa7a3cdc-f48c-4301-802e-8090fe122245 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:05.629392 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-aa7a3cdc-f48c-4301-802e-8090fe122245 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:05.630277 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-aa7a3cdc-f48c-4301-802e-8090fe122245 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:05.630747 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-aa7a3cdc-f48c-4301-802e-8090fe122245 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:05.695479 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-aa7a3cdc-f48c-4301-802e-8090fe122245 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:05.702938 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-aa7a3cdc-f48c-4301-802e-8090fe122245 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91" status: 200 len: 1277 microversion: 2.1 time: 0.084795 Feb 16 14:28:05.704136 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 221/394] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:05 2022] GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91 => generated 1277 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:05.838906 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a479596c-b574-42ed-9f36-d56d27256630 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:05.839514 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a479596c-b574-42ed-9f36-d56d27256630 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:05.846595 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a479596c-b574-42ed-9f36-d56d27256630 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:05.847077 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a479596c-b574-42ed-9f36-d56d27256630 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:05.847865 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a479596c-b574-42ed-9f36-d56d27256630 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:05.848298 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a479596c-b574-42ed-9f36-d56d27256630 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:06.061058 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a479596c-b574-42ed-9f36-d56d27256630 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:06.069518 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a479596c-b574-42ed-9f36-d56d27256630 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:06.071119 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a479596c-b574-42ed-9f36-d56d27256630 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:06.072350 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a479596c-b574-42ed-9f36-d56d27256630 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1725 microversion: 2.20 time: 0.237161 Feb 16 14:28:06.072902 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 174/395] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:05 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1725 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:28:06.500492 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-3a5bd971-3fe8-4fdc-a973-0957c882f230 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:06.501159 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-3a5bd971-3fe8-4fdc-a973-0957c882f230 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:06.511029 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3a5bd971-3fe8-4fdc-a973-0957c882f230 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:06.511488 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3a5bd971-3fe8-4fdc-a973-0957c882f230 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:06.514803 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3a5bd971-3fe8-4fdc-a973-0957c882f230 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:06.516078 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3a5bd971-3fe8-4fdc-a973-0957c882f230 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:06.569889 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-b4febee3-4485-40b7-8ab8-e73eada7a599 req-4e8950b9-7be7-48bf-80b9-a16f3e7a63d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2139817-3f2e-4e56-87d6-a56a2ca2f6f9", "name": "network-vif-unplugged", "status": "completed", "tag": "e636434b-73f6-458a-9681-a71516b2260d"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:28:06.571501 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:28:06.571501 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: warnings.warn(msg) Feb 16 14:28:06.590251 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-b4febee3-4485-40b7-8ab8-e73eada7a599 req-4e8950b9-7be7-48bf-80b9-a16f3e7a63d4 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:06.590251 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-b4febee3-4485-40b7-8ab8-e73eada7a599 req-4e8950b9-7be7-48bf-80b9-a16f3e7a63d4 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:06.601974 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-b4febee3-4485-40b7-8ab8-e73eada7a599 req-4e8950b9-7be7-48bf-80b9-a16f3e7a63d4 service nova] Creating event network-vif-unplugged:e636434b-73f6-458a-9681-a71516b2260d for instance e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 on hv-cinder-80473 Feb 16 14:28:06.607306 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-b4febee3-4485-40b7-8ab8-e73eada7a599 req-4e8950b9-7be7-48bf-80b9-a16f3e7a63d4 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041013 Feb 16 14:28:06.608411 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 175/396] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 14:28:06.722427 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ffb782b4-2b0e-4f7d-bd3f-78dae58eaa29 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:06.723308 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ffb782b4-2b0e-4f7d-bd3f-78dae58eaa29 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: 897873de-9c9e-4336-b6c5-4bf241507c91] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:06.730489 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ffb782b4-2b0e-4f7d-bd3f-78dae58eaa29 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:06.730973 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ffb782b4-2b0e-4f7d-bd3f-78dae58eaa29 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:06.732457 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-3a5bd971-3fe8-4fdc-a973-0957c882f230 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:06.737670 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ffb782b4-2b0e-4f7d-bd3f-78dae58eaa29 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:06.739325 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ffb782b4-2b0e-4f7d-bd3f-78dae58eaa29 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:06.745900 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-3a5bd971-3fe8-4fdc-a973-0957c882f230 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1571 microversion: 2.1 time: 0.250681 Feb 16 14:28:06.756851 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 222/397] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:06 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1571 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:07.015919 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ffb782b4-2b0e-4f7d-bd3f-78dae58eaa29 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:07.023257 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ffb782b4-2b0e-4f7d-bd3f-78dae58eaa29 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91" status: 200 len: 1317 microversion: 2.1 time: 0.305467 Feb 16 14:28:07.023833 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 176/398] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:06 2022] GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91 => generated 1317 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:28:07.091673 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-3eadb38c-e728-4d40-9048-f1b568609def tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:07.092299 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-3eadb38c-e728-4d40-9048-f1b568609def tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:07.098777 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3eadb38c-e728-4d40-9048-f1b568609def tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:07.099283 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3eadb38c-e728-4d40-9048-f1b568609def tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:07.100059 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3eadb38c-e728-4d40-9048-f1b568609def tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:07.100484 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3eadb38c-e728-4d40-9048-f1b568609def tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:07.289557 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-3eadb38c-e728-4d40-9048-f1b568609def tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:07.296421 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-3eadb38c-e728-4d40-9048-f1b568609def tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:07.298222 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-3eadb38c-e728-4d40-9048-f1b568609def tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:07.301767 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-3eadb38c-e728-4d40-9048-f1b568609def tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1725 microversion: 2.20 time: 0.212212 Feb 16 14:28:07.302790 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 223/399] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:07 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1725 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:28:07.602455 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-f9637b80-3e08-4869-b79f-ab892f8a07bc req-10b1c79d-1cff-46b4-b2b9-dd54b23104c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "897873de-9c9e-4336-b6c5-4bf241507c91", "tag": "f11a2a7a-f280-4d5e-8f52-d78dce060a80"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:28:07.604236 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:28:07.604236 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: warnings.warn(msg) Feb 16 14:28:07.612426 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-f9637b80-3e08-4869-b79f-ab892f8a07bc req-10b1c79d-1cff-46b4-b2b9-dd54b23104c0 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:07.612877 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-f9637b80-3e08-4869-b79f-ab892f8a07bc req-10b1c79d-1cff-46b4-b2b9-dd54b23104c0 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:07.625327 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-f9637b80-3e08-4869-b79f-ab892f8a07bc req-10b1c79d-1cff-46b4-b2b9-dd54b23104c0 service nova] Creating event network-changed:f11a2a7a-f280-4d5e-8f52-d78dce060a80 for instance 897873de-9c9e-4336-b6c5-4bf241507c91 on hv-cinder-80473 Feb 16 14:28:07.631671 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-f9637b80-3e08-4869-b79f-ab892f8a07bc req-10b1c79d-1cff-46b4-b2b9-dd54b23104c0 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032545 Feb 16 14:28:07.636831 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 177/400] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:28:07.763449 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-e8155993-e810-4f55-abd5-4b38e3926970 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:07.764643 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-e8155993-e810-4f55-abd5-4b38e3926970 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:07.770610 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e8155993-e810-4f55-abd5-4b38e3926970 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:07.771148 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e8155993-e810-4f55-abd5-4b38e3926970 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:07.771925 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e8155993-e810-4f55-abd5-4b38e3926970 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:07.772357 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e8155993-e810-4f55-abd5-4b38e3926970 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:07.914578 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-e8155993-e810-4f55-abd5-4b38e3926970 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:07.923659 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-e8155993-e810-4f55-abd5-4b38e3926970 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1571 microversion: 2.1 time: 0.163731 Feb 16 14:28:07.926225 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 224/401] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:07 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1571 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:08.045835 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-2d240d19-248d-4a4e-92da-7e145636d821 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:08.045835 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-2d240d19-248d-4a4e-92da-7e145636d821 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: 897873de-9c9e-4336-b6c5-4bf241507c91] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:08.059430 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2d240d19-248d-4a4e-92da-7e145636d821 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:08.059430 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2d240d19-248d-4a4e-92da-7e145636d821 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:08.059430 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2d240d19-248d-4a4e-92da-7e145636d821 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:08.059960 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2d240d19-248d-4a4e-92da-7e145636d821 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:08.214679 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-2d240d19-248d-4a4e-92da-7e145636d821 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:08.222994 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-2d240d19-248d-4a4e-92da-7e145636d821 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91" status: 200 len: 1317 microversion: 2.1 time: 0.184120 Feb 16 14:28:08.223557 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 178/402] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:08 2022] GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91 => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:08.319352 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-0437dd0c-e069-4ee3-a84e-09d16410ac1a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:08.319951 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-0437dd0c-e069-4ee3-a84e-09d16410ac1a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:08.325677 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0437dd0c-e069-4ee3-a84e-09d16410ac1a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:08.326122 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0437dd0c-e069-4ee3-a84e-09d16410ac1a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:08.328551 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0437dd0c-e069-4ee3-a84e-09d16410ac1a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:08.328551 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0437dd0c-e069-4ee3-a84e-09d16410ac1a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:08.463424 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-0437dd0c-e069-4ee3-a84e-09d16410ac1a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:08.471174 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-0437dd0c-e069-4ee3-a84e-09d16410ac1a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:08.472687 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-0437dd0c-e069-4ee3-a84e-09d16410ac1a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:08.473818 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-0437dd0c-e069-4ee3-a84e-09d16410ac1a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1728 microversion: 2.20 time: 0.158075 Feb 16 14:28:08.474381 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 225/403] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:08 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:28:08.491402 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-be803bed-b210-40a3-a49b-87f066be695d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c5948b5-1967-4095-8b67-adf621809977"}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:28:08.492443 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-be803bed-b210-40a3-a49b-87f066be695d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:08.498416 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-be803bed-b210-40a3-a49b-87f066be695d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:08.498932 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-be803bed-b210-40a3-a49b-87f066be695d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:08.500324 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-be803bed-b210-40a3-a49b-87f066be695d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:08.500747 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-be803bed-b210-40a3-a49b-87f066be695d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:08.941283 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-863238a1-0312-4007-a85a-7c1fcf7bdacb tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:08.941857 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-863238a1-0312-4007-a85a-7c1fcf7bdacb tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:08.947653 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-863238a1-0312-4007-a85a-7c1fcf7bdacb tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:08.948091 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-863238a1-0312-4007-a85a-7c1fcf7bdacb tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:08.948858 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-863238a1-0312-4007-a85a-7c1fcf7bdacb tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:08.949300 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-863238a1-0312-4007-a85a-7c1fcf7bdacb tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:09.084211 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-863238a1-0312-4007-a85a-7c1fcf7bdacb tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:09.091865 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-863238a1-0312-4007-a85a-7c1fcf7bdacb tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1571 microversion: 2.1 time: 0.154817 Feb 16 14:28:09.092427 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 226/404] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:08 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:09.239725 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-f1d8fd10-f96d-4f7b-af9c-b421581dbd59 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:09.240251 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-f1d8fd10-f96d-4f7b-af9c-b421581dbd59 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: 897873de-9c9e-4336-b6c5-4bf241507c91] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:09.246115 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f1d8fd10-f96d-4f7b-af9c-b421581dbd59 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:09.246562 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f1d8fd10-f96d-4f7b-af9c-b421581dbd59 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:09.247394 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f1d8fd10-f96d-4f7b-af9c-b421581dbd59 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:09.247833 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f1d8fd10-f96d-4f7b-af9c-b421581dbd59 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:09.385201 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-f1d8fd10-f96d-4f7b-af9c-b421581dbd59 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:09.392408 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-f1d8fd10-f96d-4f7b-af9c-b421581dbd59 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91" status: 200 len: 1317 microversion: 2.1 time: 0.156441 Feb 16 14:28:09.392969 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 227/405] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:09 2022] GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:09.574223 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-be803bed-b210-40a3-a49b-87f066be695d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "POST /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.086645 Feb 16 14:28:09.574885 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 179/406] 10.222.0.110 () {62 vars in 1368 bytes} [Wed Feb 16 14:28:08 2022] POST /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9/os-volume_attachments => generated 188 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 16 14:28:09.685396 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-bc4f7809-846e-407e-9a5d-d60909639779 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:28:09.685950 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-bc4f7809-846e-407e-9a5d-d60909639779 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:09.694053 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-bc4f7809-846e-407e-9a5d-d60909639779 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:09.694053 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-bc4f7809-846e-407e-9a5d-d60909639779 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:09.694053 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-bc4f7809-846e-407e-9a5d-d60909639779 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:09.694053 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-bc4f7809-846e-407e-9a5d-d60909639779 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:09.908742 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-bc4f7809-846e-407e-9a5d-d60909639779 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "POST /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9/action" status: 202 len: 0 microversion: 2.20 time: 0.226945 Feb 16 14:28:09.909342 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 228/407] 10.222.0.110 () {62 vars in 1323 bytes} [Wed Feb 16 14:28:09 2022] POST /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 16 14:28:09.917283 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-d88f5197-97d6-4d29-b05c-e0b2f5e45fb2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:09.917892 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-d88f5197-97d6-4d29-b05c-e0b2f5e45fb2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:09.924441 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d88f5197-97d6-4d29-b05c-e0b2f5e45fb2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:09.924889 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d88f5197-97d6-4d29-b05c-e0b2f5e45fb2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:09.925686 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d88f5197-97d6-4d29-b05c-e0b2f5e45fb2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:09.926121 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d88f5197-97d6-4d29-b05c-e0b2f5e45fb2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:10.063862 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d88f5197-97d6-4d29-b05c-e0b2f5e45fb2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:10.072622 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d88f5197-97d6-4d29-b05c-e0b2f5e45fb2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:10.074155 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d88f5197-97d6-4d29-b05c-e0b2f5e45fb2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:10.075330 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-d88f5197-97d6-4d29-b05c-e0b2f5e45fb2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1814 microversion: 2.20 time: 0.161860 Feb 16 14:28:10.075927 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 180/408] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:09 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1814 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:28:10.109043 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-d287786b-a24d-480f-9380-752e466e8d07 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:10.109829 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-d287786b-a24d-480f-9380-752e466e8d07 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:10.115659 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d287786b-a24d-480f-9380-752e466e8d07 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:10.116174 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d287786b-a24d-480f-9380-752e466e8d07 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:10.117023 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d287786b-a24d-480f-9380-752e466e8d07 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:10.117548 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d287786b-a24d-480f-9380-752e466e8d07 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:10.253234 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-d287786b-a24d-480f-9380-752e466e8d07 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:10.261276 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-d287786b-a24d-480f-9380-752e466e8d07 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1571 microversion: 2.1 time: 0.156022 Feb 16 14:28:10.261838 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 229/409] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:10 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1571 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:10.408820 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-db0ec081-ee29-4560-b119-1669ba83e1a4 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:10.409469 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-db0ec081-ee29-4560-b119-1669ba83e1a4 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: 897873de-9c9e-4336-b6c5-4bf241507c91] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:10.415452 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-db0ec081-ee29-4560-b119-1669ba83e1a4 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:10.415961 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-db0ec081-ee29-4560-b119-1669ba83e1a4 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:10.416867 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-db0ec081-ee29-4560-b119-1669ba83e1a4 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:10.417088 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-db0ec081-ee29-4560-b119-1669ba83e1a4 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:10.554785 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-db0ec081-ee29-4560-b119-1669ba83e1a4 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:10.562064 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-db0ec081-ee29-4560-b119-1669ba83e1a4 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91" status: 200 len: 1317 microversion: 2.1 time: 0.157250 Feb 16 14:28:10.563494 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 181/410] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:10 2022] GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:11.095843 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-c0b91385-e8b8-4341-9da0-b6359a11d1a7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:11.096556 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-c0b91385-e8b8-4341-9da0-b6359a11d1a7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:11.102428 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c0b91385-e8b8-4341-9da0-b6359a11d1a7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:11.103112 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c0b91385-e8b8-4341-9da0-b6359a11d1a7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:11.106468 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c0b91385-e8b8-4341-9da0-b6359a11d1a7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:11.106468 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c0b91385-e8b8-4341-9da0-b6359a11d1a7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:11.245397 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-c0b91385-e8b8-4341-9da0-b6359a11d1a7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:11.254320 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-c0b91385-e8b8-4341-9da0-b6359a11d1a7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:11.255917 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-c0b91385-e8b8-4341-9da0-b6359a11d1a7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:11.257121 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-c0b91385-e8b8-4341-9da0-b6359a11d1a7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1814 microversion: 2.20 time: 0.166263 Feb 16 14:28:11.257855 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 230/411] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:11 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1814 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:28:11.277589 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-1c62889c-1b63-41c2-91c3-98fe790d80f1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:11.278947 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-1c62889c-1b63-41c2-91c3-98fe790d80f1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:11.287249 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1c62889c-1b63-41c2-91c3-98fe790d80f1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:11.287911 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1c62889c-1b63-41c2-91c3-98fe790d80f1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:11.288714 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1c62889c-1b63-41c2-91c3-98fe790d80f1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:11.289153 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1c62889c-1b63-41c2-91c3-98fe790d80f1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:11.497678 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-1c62889c-1b63-41c2-91c3-98fe790d80f1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:11.506240 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-1c62889c-1b63-41c2-91c3-98fe790d80f1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1551 microversion: 2.1 time: 0.232452 Feb 16 14:28:11.506813 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 182/412] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:11 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1551 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:11.523075 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-44010065-9b21-424a-87a9-463d160f51e7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:11.523566 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-44010065-9b21-424a-87a9-463d160f51e7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:11.529324 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-44010065-9b21-424a-87a9-463d160f51e7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:11.529768 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-44010065-9b21-424a-87a9-463d160f51e7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:11.530545 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-44010065-9b21-424a-87a9-463d160f51e7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:11.532142 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-44010065-9b21-424a-87a9-463d160f51e7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:11.580061 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-968824db-a960-4522-9d83-6496d7a34214 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:11.580674 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-968824db-a960-4522-9d83-6496d7a34214 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: 897873de-9c9e-4336-b6c5-4bf241507c91] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:11.587568 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-968824db-a960-4522-9d83-6496d7a34214 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:11.588435 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-968824db-a960-4522-9d83-6496d7a34214 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:11.589247 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-968824db-a960-4522-9d83-6496d7a34214 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:11.589679 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-968824db-a960-4522-9d83-6496d7a34214 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:11.658274 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.wsgi [None req-44010065-9b21-424a-87a9-463d160f51e7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] HTTP exception thrown: Cannot 'detach_volume' instance 05accb7b-6275-4c8e-a18b-69b67bdc1d8d while it is in vm_state rescued Feb 16 14:28:11.658908 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-44010065-9b21-424a-87a9-463d160f51e7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Returning 409 to user: Cannot 'detach_volume' instance 05accb7b-6275-4c8e-a18b-69b67bdc1d8d while it is in vm_state rescued {{(pid=117031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:28:11.659836 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-44010065-9b21-424a-87a9-463d160f51e7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "DELETE /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d/os-volume_attachments/15362d59-8192-4046-828d-187fe4cc9190" status: 409 len: 152 microversion: 2.1 time: 0.140471 Feb 16 14:28:11.660628 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 231/413] 10.222.0.110 () {58 vars in 1420 bytes} [Wed Feb 16 14:28:11 2022] DELETE /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d/os-volume_attachments/15362d59-8192-4046-828d-187fe4cc9190 => generated 152 bytes in 142 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Feb 16 14:28:11.668491 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-cfc9cd0c-9b7b-434e-ad16-85393de16d70 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:28:11.669042 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-cfc9cd0c-9b7b-434e-ad16-85393de16d70 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:11.675631 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-cfc9cd0c-9b7b-434e-ad16-85393de16d70 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:11.676076 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-cfc9cd0c-9b7b-434e-ad16-85393de16d70 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:11.676861 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-cfc9cd0c-9b7b-434e-ad16-85393de16d70 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:11.677299 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-cfc9cd0c-9b7b-434e-ad16-85393de16d70 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:11.940311 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-cfc9cd0c-9b7b-434e-ad16-85393de16d70 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "POST /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d/action" status: 202 len: 0 microversion: 2.1 time: 0.275176 Feb 16 14:28:11.944053 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 232/414] 10.222.0.110 () {60 vars in 1282 bytes} [Wed Feb 16 14:28:11 2022] POST /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 16 14:28:11.949360 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-d23b95de-1387-44f0-bfd7-d3e61ed94b57 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:11.950371 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-d23b95de-1387-44f0-bfd7-d3e61ed94b57 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:11.955748 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-968824db-a960-4522-9d83-6496d7a34214 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:11.957265 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d23b95de-1387-44f0-bfd7-d3e61ed94b57 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:11.957714 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d23b95de-1387-44f0-bfd7-d3e61ed94b57 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:11.958509 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d23b95de-1387-44f0-bfd7-d3e61ed94b57 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:11.958988 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d23b95de-1387-44f0-bfd7-d3e61ed94b57 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:11.964073 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-968824db-a960-4522-9d83-6496d7a34214 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91" status: 200 len: 1317 microversion: 2.1 time: 0.388593 Feb 16 14:28:11.964768 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 183/415] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:11 2022] GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91 => generated 1317 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:28:12.093029 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-d23b95de-1387-44f0-bfd7-d3e61ed94b57 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:12.101635 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-d23b95de-1387-44f0-bfd7-d3e61ed94b57 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1559 microversion: 2.1 time: 0.156283 Feb 16 14:28:12.105444 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 233/416] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:11 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:28:12.276561 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-d81d93d7-c7da-433f-856c-5be27f87685c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:12.277172 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-d81d93d7-c7da-433f-856c-5be27f87685c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:12.289245 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d81d93d7-c7da-433f-856c-5be27f87685c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:12.289245 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d81d93d7-c7da-433f-856c-5be27f87685c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:12.289245 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d81d93d7-c7da-433f-856c-5be27f87685c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:12.289245 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d81d93d7-c7da-433f-856c-5be27f87685c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:12.528459 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d81d93d7-c7da-433f-856c-5be27f87685c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:12.537825 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d81d93d7-c7da-433f-856c-5be27f87685c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:12.539158 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d81d93d7-c7da-433f-856c-5be27f87685c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:12.540701 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-d81d93d7-c7da-433f-856c-5be27f87685c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1756 microversion: 2.20 time: 0.268232 Feb 16 14:28:12.541353 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 184/417] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:12 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1756 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:28:12.982615 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-43c30ef8-3975-4f57-bedd-2937ff276ccb tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:12.983234 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-43c30ef8-3975-4f57-bedd-2937ff276ccb tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: 897873de-9c9e-4336-b6c5-4bf241507c91] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:12.990226 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-43c30ef8-3975-4f57-bedd-2937ff276ccb tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:12.990690 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-43c30ef8-3975-4f57-bedd-2937ff276ccb tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:12.991593 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-43c30ef8-3975-4f57-bedd-2937ff276ccb tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:12.991991 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-43c30ef8-3975-4f57-bedd-2937ff276ccb tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:13.121388 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-78038f80-a354-47a3-ace7-60028b030619 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:13.122415 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-78038f80-a354-47a3-ace7-60028b030619 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:13.129533 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-78038f80-a354-47a3-ace7-60028b030619 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:13.129700 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-43c30ef8-3975-4f57-bedd-2937ff276ccb tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:13.130084 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-78038f80-a354-47a3-ace7-60028b030619 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:13.131114 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-78038f80-a354-47a3-ace7-60028b030619 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:13.131628 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-78038f80-a354-47a3-ace7-60028b030619 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:13.139011 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-43c30ef8-3975-4f57-bedd-2937ff276ccb tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91" status: 200 len: 1317 microversion: 2.1 time: 0.159954 Feb 16 14:28:13.139704 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 234/418] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:12 2022] GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:13.273970 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-78038f80-a354-47a3-ace7-60028b030619 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:13.282731 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-78038f80-a354-47a3-ace7-60028b030619 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1559 microversion: 2.1 time: 0.166749 Feb 16 14:28:13.283308 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 185/419] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:13 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:28:13.560010 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-740455a9-1605-4996-9239-2fa8e7f8cdd4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:13.560616 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-740455a9-1605-4996-9239-2fa8e7f8cdd4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:13.567090 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-740455a9-1605-4996-9239-2fa8e7f8cdd4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:13.567532 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-740455a9-1605-4996-9239-2fa8e7f8cdd4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:13.568317 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-740455a9-1605-4996-9239-2fa8e7f8cdd4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:13.568774 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-740455a9-1605-4996-9239-2fa8e7f8cdd4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:13.701405 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-740455a9-1605-4996-9239-2fa8e7f8cdd4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:13.710664 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-740455a9-1605-4996-9239-2fa8e7f8cdd4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:13.712163 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-740455a9-1605-4996-9239-2fa8e7f8cdd4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:13.713305 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-740455a9-1605-4996-9239-2fa8e7f8cdd4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1756 microversion: 2.20 time: 0.157284 Feb 16 14:28:13.713856 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 235/420] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:13 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1756 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:28:14.155825 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e30b8810-c16a-4eac-93fa-8b8cf6734286 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:14.156549 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-e30b8810-c16a-4eac-93fa-8b8cf6734286 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: 897873de-9c9e-4336-b6c5-4bf241507c91] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:14.162897 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e30b8810-c16a-4eac-93fa-8b8cf6734286 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:14.163355 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e30b8810-c16a-4eac-93fa-8b8cf6734286 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:14.164137 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e30b8810-c16a-4eac-93fa-8b8cf6734286 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:14.164576 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e30b8810-c16a-4eac-93fa-8b8cf6734286 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:14.295702 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-e30b8810-c16a-4eac-93fa-8b8cf6734286 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:14.300116 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-1b3929d3-acbc-4617-ae08-37a47d68c8b7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:14.300719 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-1b3929d3-acbc-4617-ae08-37a47d68c8b7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:14.303984 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-e30b8810-c16a-4eac-93fa-8b8cf6734286 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91" status: 200 len: 1317 microversion: 2.1 time: 0.151875 Feb 16 14:28:14.304843 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 186/421] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:14 2022] GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:14.306655 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1b3929d3-acbc-4617-ae08-37a47d68c8b7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:14.307111 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1b3929d3-acbc-4617-ae08-37a47d68c8b7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:14.307904 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1b3929d3-acbc-4617-ae08-37a47d68c8b7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:14.308455 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1b3929d3-acbc-4617-ae08-37a47d68c8b7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:14.443566 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-1b3929d3-acbc-4617-ae08-37a47d68c8b7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:14.451540 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-1b3929d3-acbc-4617-ae08-37a47d68c8b7 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1559 microversion: 2.1 time: 0.155876 Feb 16 14:28:14.452085 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 236/422] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:14 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:28:14.730821 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-0dfc27b4-ac12-44ca-8069-5b994f5b8476 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:14.731358 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-0dfc27b4-ac12-44ca-8069-5b994f5b8476 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:14.737309 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0dfc27b4-ac12-44ca-8069-5b994f5b8476 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:14.737765 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0dfc27b4-ac12-44ca-8069-5b994f5b8476 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:14.738547 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0dfc27b4-ac12-44ca-8069-5b994f5b8476 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:14.739017 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0dfc27b4-ac12-44ca-8069-5b994f5b8476 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:14.885810 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-0dfc27b4-ac12-44ca-8069-5b994f5b8476 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:14.894712 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-0dfc27b4-ac12-44ca-8069-5b994f5b8476 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:14.896216 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-0dfc27b4-ac12-44ca-8069-5b994f5b8476 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:14.897394 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-0dfc27b4-ac12-44ca-8069-5b994f5b8476 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1756 microversion: 2.20 time: 0.170413 Feb 16 14:28:14.897949 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 187/423] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:14 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:28:15.321414 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-97acc6ea-35d6-4eaa-869b-f04819280d24 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:15.322007 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-97acc6ea-35d6-4eaa-869b-f04819280d24 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: 897873de-9c9e-4336-b6c5-4bf241507c91] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:15.328558 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-97acc6ea-35d6-4eaa-869b-f04819280d24 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:15.343103 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-97acc6ea-35d6-4eaa-869b-f04819280d24 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:15.343103 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-97acc6ea-35d6-4eaa-869b-f04819280d24 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:15.343103 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-97acc6ea-35d6-4eaa-869b-f04819280d24 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:15.468994 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-3b8cd5b6-17dc-430b-8810-15652b582e36 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:15.469678 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-3b8cd5b6-17dc-430b-8810-15652b582e36 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:15.475666 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-97acc6ea-35d6-4eaa-869b-f04819280d24 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:15.476232 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3b8cd5b6-17dc-430b-8810-15652b582e36 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:15.476692 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3b8cd5b6-17dc-430b-8810-15652b582e36 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:15.477533 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3b8cd5b6-17dc-430b-8810-15652b582e36 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:15.477976 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3b8cd5b6-17dc-430b-8810-15652b582e36 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:15.483029 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-97acc6ea-35d6-4eaa-869b-f04819280d24 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91" status: 200 len: 1317 microversion: 2.1 time: 0.165102 Feb 16 14:28:15.483626 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 237/424] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:15 2022] GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:15.625711 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3b8cd5b6-17dc-430b-8810-15652b582e36 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:15.633501 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-3b8cd5b6-17dc-430b-8810-15652b582e36 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1559 microversion: 2.1 time: 0.168504 Feb 16 14:28:15.634074 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 188/425] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:15 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:28:15.917313 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-854c4329-5e7d-482e-bcfc-e16480d23c26 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:15.918696 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-854c4329-5e7d-482e-bcfc-e16480d23c26 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:15.926000 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-854c4329-5e7d-482e-bcfc-e16480d23c26 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:15.926397 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-854c4329-5e7d-482e-bcfc-e16480d23c26 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:15.927473 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-854c4329-5e7d-482e-bcfc-e16480d23c26 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:15.927913 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-854c4329-5e7d-482e-bcfc-e16480d23c26 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:16.067945 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-854c4329-5e7d-482e-bcfc-e16480d23c26 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:16.076665 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-854c4329-5e7d-482e-bcfc-e16480d23c26 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:16.079097 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-854c4329-5e7d-482e-bcfc-e16480d23c26 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:16.080247 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-854c4329-5e7d-482e-bcfc-e16480d23c26 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1756 microversion: 2.20 time: 0.167898 Feb 16 14:28:16.080803 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 238/426] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:15 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:28:16.507825 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6419a4e5-5b79-48cc-bbe1-45751585463f tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:16.508464 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-6419a4e5-5b79-48cc-bbe1-45751585463f tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: 897873de-9c9e-4336-b6c5-4bf241507c91] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:16.514680 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6419a4e5-5b79-48cc-bbe1-45751585463f tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:16.515351 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6419a4e5-5b79-48cc-bbe1-45751585463f tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:16.516136 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6419a4e5-5b79-48cc-bbe1-45751585463f tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:16.516572 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6419a4e5-5b79-48cc-bbe1-45751585463f tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:16.650812 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-f6510fd6-ceeb-4f52-9b1b-076f775c3d87 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:16.651413 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-f6510fd6-ceeb-4f52-9b1b-076f775c3d87 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:16.657689 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f6510fd6-ceeb-4f52-9b1b-076f775c3d87 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:16.658351 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f6510fd6-ceeb-4f52-9b1b-076f775c3d87 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:16.659039 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6419a4e5-5b79-48cc-bbe1-45751585463f tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:16.659160 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f6510fd6-ceeb-4f52-9b1b-076f775c3d87 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:16.659518 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f6510fd6-ceeb-4f52-9b1b-076f775c3d87 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:16.666554 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-6419a4e5-5b79-48cc-bbe1-45751585463f tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91" status: 200 len: 1317 microversion: 2.1 time: 0.167283 Feb 16 14:28:16.667248 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 189/427] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:16 2022] GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:16.799919 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-f6510fd6-ceeb-4f52-9b1b-076f775c3d87 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:16.807746 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-f6510fd6-ceeb-4f52-9b1b-076f775c3d87 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1559 microversion: 2.1 time: 0.160887 Feb 16 14:28:16.808305 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 239/428] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:16 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:28:17.098415 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-4cc751af-5878-4674-a35d-c65f2fb936ef tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:17.099257 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-4cc751af-5878-4674-a35d-c65f2fb936ef tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:17.105022 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4cc751af-5878-4674-a35d-c65f2fb936ef tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:17.105473 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4cc751af-5878-4674-a35d-c65f2fb936ef tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:17.106257 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4cc751af-5878-4674-a35d-c65f2fb936ef tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:17.106740 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4cc751af-5878-4674-a35d-c65f2fb936ef tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:17.247902 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-4cc751af-5878-4674-a35d-c65f2fb936ef tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:17.257365 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-4cc751af-5878-4674-a35d-c65f2fb936ef tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:17.258925 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-4cc751af-5878-4674-a35d-c65f2fb936ef tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:17.260126 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-4cc751af-5878-4674-a35d-c65f2fb936ef tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1756 microversion: 2.20 time: 0.165786 Feb 16 14:28:17.260680 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 190/429] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:17 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:28:17.683900 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-3eb5cbb0-0bfd-4047-b1be-04cb5e63f5e3 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:17.684767 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-3eb5cbb0-0bfd-4047-b1be-04cb5e63f5e3 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: 897873de-9c9e-4336-b6c5-4bf241507c91] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:17.691496 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3eb5cbb0-0bfd-4047-b1be-04cb5e63f5e3 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:17.692020 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3eb5cbb0-0bfd-4047-b1be-04cb5e63f5e3 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:17.692870 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3eb5cbb0-0bfd-4047-b1be-04cb5e63f5e3 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:17.693373 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3eb5cbb0-0bfd-4047-b1be-04cb5e63f5e3 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:17.823764 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-5d2ae99a-4ffd-4086-a596-7f40a30e0d71 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:17.824513 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-5d2ae99a-4ffd-4086-a596-7f40a30e0d71 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:17.828192 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-3eb5cbb0-0bfd-4047-b1be-04cb5e63f5e3 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:17.832402 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5d2ae99a-4ffd-4086-a596-7f40a30e0d71 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:17.833065 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5d2ae99a-4ffd-4086-a596-7f40a30e0d71 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:17.833891 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5d2ae99a-4ffd-4086-a596-7f40a30e0d71 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:17.834330 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5d2ae99a-4ffd-4086-a596-7f40a30e0d71 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:17.835999 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-3eb5cbb0-0bfd-4047-b1be-04cb5e63f5e3 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91" status: 200 len: 1317 microversion: 2.1 time: 0.155786 Feb 16 14:28:17.837135 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 240/430] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:17 2022] GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:17.973241 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-5d2ae99a-4ffd-4086-a596-7f40a30e0d71 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:17.982456 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-5d2ae99a-4ffd-4086-a596-7f40a30e0d71 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1559 microversion: 2.1 time: 0.162276 Feb 16 14:28:17.983056 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 191/431] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:17 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:28:18.278208 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-1a8f8d3f-d58e-47bd-8df0-0744e0468f86 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:18.278869 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-1a8f8d3f-d58e-47bd-8df0-0744e0468f86 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:18.285025 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1a8f8d3f-d58e-47bd-8df0-0744e0468f86 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:18.285467 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1a8f8d3f-d58e-47bd-8df0-0744e0468f86 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:18.286264 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1a8f8d3f-d58e-47bd-8df0-0744e0468f86 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:18.286719 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1a8f8d3f-d58e-47bd-8df0-0744e0468f86 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:18.416828 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-1a8f8d3f-d58e-47bd-8df0-0744e0468f86 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:18.425498 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-1a8f8d3f-d58e-47bd-8df0-0744e0468f86 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:18.427026 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-1a8f8d3f-d58e-47bd-8df0-0744e0468f86 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:18.428161 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-1a8f8d3f-d58e-47bd-8df0-0744e0468f86 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1756 microversion: 2.20 time: 0.153862 Feb 16 14:28:18.428729 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 241/432] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:18 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1756 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:28:18.853249 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-102302c9-7ae8-479e-a430-8954ac2ea36b tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:18.853859 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-102302c9-7ae8-479e-a430-8954ac2ea36b tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: 897873de-9c9e-4336-b6c5-4bf241507c91] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:18.860884 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-102302c9-7ae8-479e-a430-8954ac2ea36b tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:18.861345 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-102302c9-7ae8-479e-a430-8954ac2ea36b tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:18.862130 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-102302c9-7ae8-479e-a430-8954ac2ea36b tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:18.862567 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-102302c9-7ae8-479e-a430-8954ac2ea36b tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:18.997510 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-102302c9-7ae8-479e-a430-8954ac2ea36b tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:18.999552 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-c21bd473-27a1-4737-b1d2-3c64588e45b9 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:19.000158 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-c21bd473-27a1-4737-b1d2-3c64588e45b9 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:19.005115 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-102302c9-7ae8-479e-a430-8954ac2ea36b tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91" status: 200 len: 1317 microversion: 2.1 time: 0.155495 Feb 16 14:28:19.005876 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 192/433] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:18 2022] GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:28:19.006052 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c21bd473-27a1-4737-b1d2-3c64588e45b9 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:19.006476 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c21bd473-27a1-4737-b1d2-3c64588e45b9 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:19.007264 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c21bd473-27a1-4737-b1d2-3c64588e45b9 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:19.007813 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c21bd473-27a1-4737-b1d2-3c64588e45b9 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:19.142336 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-c21bd473-27a1-4737-b1d2-3c64588e45b9 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:19.150099 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-c21bd473-27a1-4737-b1d2-3c64588e45b9 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1559 microversion: 2.1 time: 0.154175 Feb 16 14:28:19.150677 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 242/434] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:18 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:28:19.449278 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a1c78dc5-9c84-4857-a584-589d4043c903 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:19.449833 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a1c78dc5-9c84-4857-a584-589d4043c903 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:19.456606 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a1c78dc5-9c84-4857-a584-589d4043c903 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:19.457067 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a1c78dc5-9c84-4857-a584-589d4043c903 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:19.459057 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a1c78dc5-9c84-4857-a584-589d4043c903 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:19.460274 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a1c78dc5-9c84-4857-a584-589d4043c903 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:19.619725 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a1c78dc5-9c84-4857-a584-589d4043c903 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:19.628469 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a1c78dc5-9c84-4857-a584-589d4043c903 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:19.629989 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a1c78dc5-9c84-4857-a584-589d4043c903 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:19.632298 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a1c78dc5-9c84-4857-a584-589d4043c903 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1756 microversion: 2.20 time: 0.188043 Feb 16 14:28:19.633024 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 193/435] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:19 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:28:20.021886 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-6404be0f-6e3e-4af1-96f8-7f75a57af8a3 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:20.022706 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-6404be0f-6e3e-4af1-96f8-7f75a57af8a3 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: 897873de-9c9e-4336-b6c5-4bf241507c91] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:20.030139 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-6404be0f-6e3e-4af1-96f8-7f75a57af8a3 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:20.030584 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-6404be0f-6e3e-4af1-96f8-7f75a57af8a3 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:20.031745 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-6404be0f-6e3e-4af1-96f8-7f75a57af8a3 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:20.032180 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-6404be0f-6e3e-4af1-96f8-7f75a57af8a3 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:20.169643 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-081a5057-c318-4880-8f97-54b9792d58fe tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:20.170189 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-081a5057-c318-4880-8f97-54b9792d58fe tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:20.180361 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-081a5057-c318-4880-8f97-54b9792d58fe tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:20.180817 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-081a5057-c318-4880-8f97-54b9792d58fe tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:20.181604 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-081a5057-c318-4880-8f97-54b9792d58fe tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:20.183735 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-6404be0f-6e3e-4af1-96f8-7f75a57af8a3 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:20.184869 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-081a5057-c318-4880-8f97-54b9792d58fe tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:20.191595 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-6404be0f-6e3e-4af1-96f8-7f75a57af8a3 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91" status: 200 len: 1317 microversion: 2.1 time: 0.173895 Feb 16 14:28:20.192514 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 243/436] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:20 2022] GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:20.366921 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-081a5057-c318-4880-8f97-54b9792d58fe tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:20.384079 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-081a5057-c318-4880-8f97-54b9792d58fe tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1559 microversion: 2.1 time: 0.219581 Feb 16 14:28:20.384659 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 194/437] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:20 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1559 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:20.650559 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-8dca4541-e2d4-4e08-a254-dad02a5641a9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:20.651185 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-8dca4541-e2d4-4e08-a254-dad02a5641a9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:20.657558 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8dca4541-e2d4-4e08-a254-dad02a5641a9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:20.657994 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8dca4541-e2d4-4e08-a254-dad02a5641a9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:20.658815 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8dca4541-e2d4-4e08-a254-dad02a5641a9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:20.659243 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8dca4541-e2d4-4e08-a254-dad02a5641a9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:20.681989 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-23408c47-17ee-42f8-ac2c-cf1f3b9feb3a req-00e8de44-2d34-445d-845f-a70f2f69c4e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "897873de-9c9e-4336-b6c5-4bf241507c91", "name": "network-vif-plugged", "status": "completed", "tag": "f11a2a7a-f280-4d5e-8f52-d78dce060a80"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:28:20.684585 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:28:20.684585 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: warnings.warn(msg) Feb 16 14:28:20.695368 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-23408c47-17ee-42f8-ac2c-cf1f3b9feb3a req-00e8de44-2d34-445d-845f-a70f2f69c4e3 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:20.695818 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-23408c47-17ee-42f8-ac2c-cf1f3b9feb3a req-00e8de44-2d34-445d-845f-a70f2f69c4e3 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:20.708994 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-23408c47-17ee-42f8-ac2c-cf1f3b9feb3a req-00e8de44-2d34-445d-845f-a70f2f69c4e3 service nova] Creating event network-vif-plugged:f11a2a7a-f280-4d5e-8f52-d78dce060a80 for instance 897873de-9c9e-4336-b6c5-4bf241507c91 on hv-cinder-80473 Feb 16 14:28:20.714895 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-23408c47-17ee-42f8-ac2c-cf1f3b9feb3a req-00e8de44-2d34-445d-845f-a70f2f69c4e3 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039697 Feb 16 14:28:20.721201 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 195/438] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 14:28:20.826562 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-8dca4541-e2d4-4e08-a254-dad02a5641a9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:20.837375 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-8dca4541-e2d4-4e08-a254-dad02a5641a9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:20.838930 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-8dca4541-e2d4-4e08-a254-dad02a5641a9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:20.840120 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-8dca4541-e2d4-4e08-a254-dad02a5641a9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1812 microversion: 2.20 time: 0.193302 Feb 16 14:28:20.840678 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 244/439] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:20 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1812 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:28:21.213170 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-4b5b5737-4c06-486c-a4e1-146b0c4a84c5 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:21.214963 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-4b5b5737-4c06-486c-a4e1-146b0c4a84c5 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: 897873de-9c9e-4336-b6c5-4bf241507c91] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:21.222468 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4b5b5737-4c06-486c-a4e1-146b0c4a84c5 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:21.223287 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4b5b5737-4c06-486c-a4e1-146b0c4a84c5 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:21.224269 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4b5b5737-4c06-486c-a4e1-146b0c4a84c5 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:21.225017 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4b5b5737-4c06-486c-a4e1-146b0c4a84c5 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:21.401905 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-dcf21363-fc61-4bb1-891b-727244bddcf6 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:21.402657 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-dcf21363-fc61-4bb1-891b-727244bddcf6 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:21.409560 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-dcf21363-fc61-4bb1-891b-727244bddcf6 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:21.410030 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-dcf21363-fc61-4bb1-891b-727244bddcf6 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:21.410843 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-dcf21363-fc61-4bb1-891b-727244bddcf6 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:21.411267 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-dcf21363-fc61-4bb1-891b-727244bddcf6 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:21.455561 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-4b5b5737-4c06-486c-a4e1-146b0c4a84c5 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:21.463499 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-4b5b5737-4c06-486c-a4e1-146b0c4a84c5 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91" status: 200 len: 1317 microversion: 2.1 time: 0.256395 Feb 16 14:28:21.463986 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 196/440] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:21 2022] GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91 => generated 1317 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:21.559945 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-dcf21363-fc61-4bb1-891b-727244bddcf6 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:21.568654 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-dcf21363-fc61-4bb1-891b-727244bddcf6 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1565 microversion: 2.1 time: 0.170414 Feb 16 14:28:21.574799 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 245/441] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:21 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1565 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:28:21.641781 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-26d21b7b-45b8-4149-a2d1-f49ce5853a77 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:21.642266 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-26d21b7b-45b8-4149-a2d1-f49ce5853a77 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:21.648085 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-26d21b7b-45b8-4149-a2d1-f49ce5853a77 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:21.648531 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-26d21b7b-45b8-4149-a2d1-f49ce5853a77 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:21.649375 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-26d21b7b-45b8-4149-a2d1-f49ce5853a77 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:21.649745 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-26d21b7b-45b8-4149-a2d1-f49ce5853a77 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:21.779221 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-26d21b7b-45b8-4149-a2d1-f49ce5853a77 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lazy-loading 'services' on Instance uuid 05accb7b-6275-4c8e-a18b-69b67bdc1d8d {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:28:21.858915 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-7f7e2064-071b-41b1-8b33-8014c9d92cfc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:21.859850 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-7f7e2064-071b-41b1-8b33-8014c9d92cfc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:21.866171 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7f7e2064-071b-41b1-8b33-8014c9d92cfc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:21.866653 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7f7e2064-071b-41b1-8b33-8014c9d92cfc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:21.867552 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7f7e2064-071b-41b1-8b33-8014c9d92cfc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:21.867979 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7f7e2064-071b-41b1-8b33-8014c9d92cfc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:22.026567 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-26d21b7b-45b8-4149-a2d1-f49ce5853a77 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "DELETE /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d/os-volume_attachments/15362d59-8192-4046-828d-187fe4cc9190" status: 202 len: 0 microversion: 2.1 time: 0.388360 Feb 16 14:28:22.031317 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 197/442] 10.222.0.110 () {58 vars in 1420 bytes} [Wed Feb 16 14:28:21 2022] DELETE /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d/os-volume_attachments/15362d59-8192-4046-828d-187fe4cc9190 => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 14:28:22.037383 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-516848e2-9ed8-47ed-97eb-e05f58c7188c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:22.038989 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-516848e2-9ed8-47ed-97eb-e05f58c7188c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:22.045483 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-516848e2-9ed8-47ed-97eb-e05f58c7188c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:22.045933 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-516848e2-9ed8-47ed-97eb-e05f58c7188c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:22.047161 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-516848e2-9ed8-47ed-97eb-e05f58c7188c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:22.048037 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-516848e2-9ed8-47ed-97eb-e05f58c7188c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:22.089300 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-516848e2-9ed8-47ed-97eb-e05f58c7188c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056663 Feb 16 14:28:22.095035 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 198/443] 10.222.0.110 () {58 vars in 1306 bytes} [Wed Feb 16 14:28:22 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:28:22.125353 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-7f7e2064-071b-41b1-8b33-8014c9d92cfc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:22.145932 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-7f7e2064-071b-41b1-8b33-8014c9d92cfc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:22.148486 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-7f7e2064-071b-41b1-8b33-8014c9d92cfc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:22.149890 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-7f7e2064-071b-41b1-8b33-8014c9d92cfc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1812 microversion: 2.20 time: 0.295296 Feb 16 14:28:22.179054 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 246/444] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:21 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1812 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:28:22.480914 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-74aa0db2-768d-476c-95f1-f09f19faa6f3 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:22.481962 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-74aa0db2-768d-476c-95f1-f09f19faa6f3 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: 897873de-9c9e-4336-b6c5-4bf241507c91] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:22.489316 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-74aa0db2-768d-476c-95f1-f09f19faa6f3 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:22.489868 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-74aa0db2-768d-476c-95f1-f09f19faa6f3 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:22.490981 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-74aa0db2-768d-476c-95f1-f09f19faa6f3 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:22.491438 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-74aa0db2-768d-476c-95f1-f09f19faa6f3 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:22.656509 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-74aa0db2-768d-476c-95f1-f09f19faa6f3 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:22.664045 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-74aa0db2-768d-476c-95f1-f09f19faa6f3 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91" status: 200 len: 1317 microversion: 2.1 time: 0.187188 Feb 16 14:28:22.664621 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 199/445] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:22 2022] GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91 => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:23.101094 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-038d3608-a704-4935-b5d0-3421a9910c7d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:23.102666 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-038d3608-a704-4935-b5d0-3421a9910c7d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:23.109648 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-038d3608-a704-4935-b5d0-3421a9910c7d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:23.110377 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-038d3608-a704-4935-b5d0-3421a9910c7d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:23.111374 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-038d3608-a704-4935-b5d0-3421a9910c7d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:23.111801 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-038d3608-a704-4935-b5d0-3421a9910c7d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:23.144535 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-038d3608-a704-4935-b5d0-3421a9910c7d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047013 Feb 16 14:28:23.145104 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 247/446] 10.222.0.110 () {58 vars in 1306 bytes} [Wed Feb 16 14:28:23 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:28:23.173699 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-88c7cb7f-d943-4612-85f2-9a2b1375106c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:23.174317 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-88c7cb7f-d943-4612-85f2-9a2b1375106c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:23.180397 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-88c7cb7f-d943-4612-85f2-9a2b1375106c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:23.181051 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-88c7cb7f-d943-4612-85f2-9a2b1375106c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:23.182612 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-88c7cb7f-d943-4612-85f2-9a2b1375106c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:23.183395 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-88c7cb7f-d943-4612-85f2-9a2b1375106c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:23.350402 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-88c7cb7f-d943-4612-85f2-9a2b1375106c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:23.396683 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-88c7cb7f-d943-4612-85f2-9a2b1375106c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:23.399576 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-88c7cb7f-d943-4612-85f2-9a2b1375106c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:23.438789 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-88c7cb7f-d943-4612-85f2-9a2b1375106c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1812 microversion: 2.20 time: 0.248945 Feb 16 14:28:23.444652 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 200/447] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:23 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1812 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:28:23.681770 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-91bacb1d-bfba-404d-9fd7-f9b8d7a3b02d tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:23.682661 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-91bacb1d-bfba-404d-9fd7-f9b8d7a3b02d tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: 897873de-9c9e-4336-b6c5-4bf241507c91] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:23.690600 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-91bacb1d-bfba-404d-9fd7-f9b8d7a3b02d tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:23.691780 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-91bacb1d-bfba-404d-9fd7-f9b8d7a3b02d tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:23.692665 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-91bacb1d-bfba-404d-9fd7-f9b8d7a3b02d tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:23.693102 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-91bacb1d-bfba-404d-9fd7-f9b8d7a3b02d tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:23.907679 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-91bacb1d-bfba-404d-9fd7-f9b8d7a3b02d tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:23.918844 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-91bacb1d-bfba-404d-9fd7-f9b8d7a3b02d tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91" status: 200 len: 1501 microversion: 2.1 time: 0.240544 Feb 16 14:28:23.920918 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 248/448] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:23 2022] GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91 => generated 1501 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:24.156631 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f7fa9560-c337-4230-873a-cf498d4e015d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:24.158100 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f7fa9560-c337-4230-873a-cf498d4e015d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:24.164773 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f7fa9560-c337-4230-873a-cf498d4e015d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:24.165447 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f7fa9560-c337-4230-873a-cf498d4e015d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:24.166406 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f7fa9560-c337-4230-873a-cf498d4e015d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:24.167039 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f7fa9560-c337-4230-873a-cf498d4e015d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:24.224320 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f7fa9560-c337-4230-873a-cf498d4e015d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071936 Feb 16 14:28:24.229664 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 201/449] 10.222.0.110 () {58 vars in 1306 bytes} [Wed Feb 16 14:28:24 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:28:24.462157 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-efbaa2ed-64da-44c5-88a5-6b98380ecdbc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:24.463723 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-efbaa2ed-64da-44c5-88a5-6b98380ecdbc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:24.471051 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-efbaa2ed-64da-44c5-88a5-6b98380ecdbc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:24.471921 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-efbaa2ed-64da-44c5-88a5-6b98380ecdbc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:24.472866 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-efbaa2ed-64da-44c5-88a5-6b98380ecdbc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:24.473806 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-efbaa2ed-64da-44c5-88a5-6b98380ecdbc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:24.574110 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-5554d56a-2805-4873-9124-0d8277504ceb tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:24.574819 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-5554d56a-2805-4873-9124-0d8277504ceb tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: d86c93ea-a9ad-4b0c-bc25-18f3da5bb813] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:24.583131 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5554d56a-2805-4873-9124-0d8277504ceb tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:24.583651 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5554d56a-2805-4873-9124-0d8277504ceb tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:24.584519 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5554d56a-2805-4873-9124-0d8277504ceb tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:24.585046 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5554d56a-2805-4873-9124-0d8277504ceb tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:24.692722 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-5554d56a-2805-4873-9124-0d8277504ceb tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lazy-loading 'services' on Instance uuid d86c93ea-a9ad-4b0c-bc25-18f3da5bb813 {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:28:24.737903 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-efbaa2ed-64da-44c5-88a5-6b98380ecdbc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:24.751507 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-efbaa2ed-64da-44c5-88a5-6b98380ecdbc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:24.753975 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-efbaa2ed-64da-44c5-88a5-6b98380ecdbc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:24.758665 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-efbaa2ed-64da-44c5-88a5-6b98380ecdbc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1812 microversion: 2.20 time: 0.299676 Feb 16 14:28:24.759411 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 249/450] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:24 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1812 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:28:25.044215 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-5554d56a-2805-4873-9124-0d8277504ceb tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "DELETE /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813/os-volume_attachments/84155849-517c-4aba-8717-258f03a16f17" status: 202 len: 0 microversion: 2.1 time: 0.473979 Feb 16 14:28:25.046574 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 202/451] 10.222.0.110 () {58 vars in 1420 bytes} [Wed Feb 16 14:28:24 2022] DELETE /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813/os-volume_attachments/84155849-517c-4aba-8717-258f03a16f17 => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 14:28:25.178687 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-819a10a3-ec27-4b09-9f8e-92eecf3e9f95 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:25.179463 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-819a10a3-ec27-4b09-9f8e-92eecf3e9f95 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: 897873de-9c9e-4336-b6c5-4bf241507c91] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:25.195259 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-819a10a3-ec27-4b09-9f8e-92eecf3e9f95 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:25.201068 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-819a10a3-ec27-4b09-9f8e-92eecf3e9f95 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:25.201068 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-819a10a3-ec27-4b09-9f8e-92eecf3e9f95 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:25.201068 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-819a10a3-ec27-4b09-9f8e-92eecf3e9f95 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:25.239625 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-22f61604-fa0d-47ee-80b4-17e85d822f53 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:25.240684 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-22f61604-fa0d-47ee-80b4-17e85d822f53 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:25.244754 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-819a10a3-ec27-4b09-9f8e-92eecf3e9f95 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: 897873de-9c9e-4336-b6c5-4bf241507c91] Going to try to terminate instance {{(pid=117031) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 16 14:28:25.260502 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-22f61604-fa0d-47ee-80b4-17e85d822f53 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:25.269315 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-22f61604-fa0d-47ee-80b4-17e85d822f53 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:25.269315 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-22f61604-fa0d-47ee-80b4-17e85d822f53 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:25.269315 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-22f61604-fa0d-47ee-80b4-17e85d822f53 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:25.329538 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-22f61604-fa0d-47ee-80b4-17e85d822f53 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095499 Feb 16 14:28:25.330947 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 203/452] 10.222.0.110 () {58 vars in 1306 bytes} [Wed Feb 16 14:28:25 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 14:28:25.588439 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-819a10a3-ec27-4b09-9f8e-92eecf3e9f95 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "DELETE /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91" status: 204 len: 0 microversion: 2.1 time: 0.412683 Feb 16 14:28:25.589612 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 250/453] 10.222.0.110 () {58 vars in 1243 bytes} [Wed Feb 16 14:28:25 2022] DELETE /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 16 14:28:25.607386 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-80ca754b-f111-44dd-99db-db8dcd84cee9 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:25.608370 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-80ca754b-f111-44dd-99db-db8dcd84cee9 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: 897873de-9c9e-4336-b6c5-4bf241507c91] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:25.618183 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-80ca754b-f111-44dd-99db-db8dcd84cee9 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:25.620107 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-80ca754b-f111-44dd-99db-db8dcd84cee9 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:25.621170 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-80ca754b-f111-44dd-99db-db8dcd84cee9 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:25.621825 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-80ca754b-f111-44dd-99db-db8dcd84cee9 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:25.778126 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-27b4e031-9ff6-44df-a95a-eb6ea04ea723 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:25.779340 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-27b4e031-9ff6-44df-a95a-eb6ea04ea723 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:25.788981 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-27b4e031-9ff6-44df-a95a-eb6ea04ea723 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:25.789526 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-27b4e031-9ff6-44df-a95a-eb6ea04ea723 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:25.791313 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-27b4e031-9ff6-44df-a95a-eb6ea04ea723 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:25.792401 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-27b4e031-9ff6-44df-a95a-eb6ea04ea723 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:25.807626 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-80ca754b-f111-44dd-99db-db8dcd84cee9 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:25.816855 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-80ca754b-f111-44dd-99db-db8dcd84cee9 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91" status: 200 len: 1507 microversion: 2.1 time: 0.214021 Feb 16 14:28:25.835133 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 204/454] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:25 2022] GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91 => generated 1507 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:25.970034 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-27b4e031-9ff6-44df-a95a-eb6ea04ea723 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:25.978633 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-27b4e031-9ff6-44df-a95a-eb6ea04ea723 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:25.980159 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-27b4e031-9ff6-44df-a95a-eb6ea04ea723 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:25.981319 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-27b4e031-9ff6-44df-a95a-eb6ea04ea723 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1812 microversion: 2.20 time: 0.207842 Feb 16 14:28:25.982058 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 251/455] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:25 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1812 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:28:26.341869 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c06746e6-1821-42c0-af27-56aaa606f0d9 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:26.342905 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c06746e6-1821-42c0-af27-56aaa606f0d9 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:26.350387 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c06746e6-1821-42c0-af27-56aaa606f0d9 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:26.351502 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c06746e6-1821-42c0-af27-56aaa606f0d9 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:26.351843 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c06746e6-1821-42c0-af27-56aaa606f0d9 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:26.352287 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c06746e6-1821-42c0-af27-56aaa606f0d9 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:26.399901 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c06746e6-1821-42c0-af27-56aaa606f0d9 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061876 Feb 16 14:28:26.402179 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 205/456] 10.222.0.110 () {58 vars in 1306 bytes} [Wed Feb 16 14:28:26 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:28:26.839386 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-7b9723ae-6289-491f-83e2-68fbb2f54366 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:26.840067 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-7b9723ae-6289-491f-83e2-68fbb2f54366 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: 897873de-9c9e-4336-b6c5-4bf241507c91] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:26.847344 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7b9723ae-6289-491f-83e2-68fbb2f54366 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:26.848027 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7b9723ae-6289-491f-83e2-68fbb2f54366 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:26.848996 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7b9723ae-6289-491f-83e2-68fbb2f54366 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:26.849436 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7b9723ae-6289-491f-83e2-68fbb2f54366 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:26.992741 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-7b9723ae-6289-491f-83e2-68fbb2f54366 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:26.999163 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-141f1f8f-df99-4f89-ad42-263227a6bdd7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:27.000347 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-141f1f8f-df99-4f89-ad42-263227a6bdd7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:27.001474 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-7b9723ae-6289-491f-83e2-68fbb2f54366 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91" status: 200 len: 1507 microversion: 2.1 time: 0.165628 Feb 16 14:28:27.002056 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 252/457] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:26 2022] GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91 => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:27.007816 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-141f1f8f-df99-4f89-ad42-263227a6bdd7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:27.007816 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-141f1f8f-df99-4f89-ad42-263227a6bdd7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:27.007816 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-141f1f8f-df99-4f89-ad42-263227a6bdd7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:27.008215 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-141f1f8f-df99-4f89-ad42-263227a6bdd7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:27.155379 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-141f1f8f-df99-4f89-ad42-263227a6bdd7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:27.164807 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-141f1f8f-df99-4f89-ad42-263227a6bdd7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:27.166325 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-141f1f8f-df99-4f89-ad42-263227a6bdd7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:27.167521 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-141f1f8f-df99-4f89-ad42-263227a6bdd7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1812 microversion: 2.20 time: 0.172031 Feb 16 14:28:27.171015 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 206/458] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:26 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1812 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:28:27.412186 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-e119817f-f2a8-4ef2-b7a1-0285cfe0f3b1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:27.413295 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-e119817f-f2a8-4ef2-b7a1-0285cfe0f3b1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:27.420382 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e119817f-f2a8-4ef2-b7a1-0285cfe0f3b1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:27.420920 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e119817f-f2a8-4ef2-b7a1-0285cfe0f3b1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:27.422107 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e119817f-f2a8-4ef2-b7a1-0285cfe0f3b1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:27.422740 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e119817f-f2a8-4ef2-b7a1-0285cfe0f3b1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:27.456474 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-e119817f-f2a8-4ef2-b7a1-0285cfe0f3b1 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048081 Feb 16 14:28:27.457174 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 253/459] 10.222.0.110 () {58 vars in 1306 bytes} [Wed Feb 16 14:28:27 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:28:28.019252 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-80469171-1cd8-4e16-be76-6987c47017dd tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:28.019867 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-80469171-1cd8-4e16-be76-6987c47017dd tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: 897873de-9c9e-4336-b6c5-4bf241507c91] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:28.026083 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-80469171-1cd8-4e16-be76-6987c47017dd tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:28.026548 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-80469171-1cd8-4e16-be76-6987c47017dd tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:28.027329 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-80469171-1cd8-4e16-be76-6987c47017dd tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:28.027761 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-80469171-1cd8-4e16-be76-6987c47017dd tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:28.166474 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-80469171-1cd8-4e16-be76-6987c47017dd tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:28.174511 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-80469171-1cd8-4e16-be76-6987c47017dd tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91" status: 200 len: 1507 microversion: 2.1 time: 0.159477 Feb 16 14:28:28.175136 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 207/460] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:28 2022] GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:28.187385 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-0a2fc87a-b5db-4851-b0f5-8ff412a1a6ea tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:28.188164 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-0a2fc87a-b5db-4851-b0f5-8ff412a1a6ea tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:28.194317 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0a2fc87a-b5db-4851-b0f5-8ff412a1a6ea tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:28.194809 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0a2fc87a-b5db-4851-b0f5-8ff412a1a6ea tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:28.195598 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0a2fc87a-b5db-4851-b0f5-8ff412a1a6ea tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:28.196031 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0a2fc87a-b5db-4851-b0f5-8ff412a1a6ea tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:28.345144 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-0a2fc87a-b5db-4851-b0f5-8ff412a1a6ea tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:28.354734 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-0a2fc87a-b5db-4851-b0f5-8ff412a1a6ea tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:28.356458 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-0a2fc87a-b5db-4851-b0f5-8ff412a1a6ea tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:28.357761 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-0a2fc87a-b5db-4851-b0f5-8ff412a1a6ea tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1812 microversion: 2.20 time: 0.174483 Feb 16 14:28:28.358313 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 254/461] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:28 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1812 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:28:28.469029 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-80cc3901-8ef5-442d-a053-08ab0bea436f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:28.470333 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-80cc3901-8ef5-442d-a053-08ab0bea436f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:28.478128 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-80cc3901-8ef5-442d-a053-08ab0bea436f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:28.478581 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-80cc3901-8ef5-442d-a053-08ab0bea436f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:28.479440 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-80cc3901-8ef5-442d-a053-08ab0bea436f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:28.480018 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-80cc3901-8ef5-442d-a053-08ab0bea436f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:28.517290 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-80cc3901-8ef5-442d-a053-08ab0bea436f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052794 Feb 16 14:28:28.517876 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 208/462] 10.222.0.110 () {58 vars in 1306 bytes} [Wed Feb 16 14:28:28 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:28:29.191809 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-7ab051dd-d344-4691-bffc-0163d1624bb0 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:29.193202 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-7ab051dd-d344-4691-bffc-0163d1624bb0 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: 897873de-9c9e-4336-b6c5-4bf241507c91] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:29.199216 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7ab051dd-d344-4691-bffc-0163d1624bb0 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:29.199652 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7ab051dd-d344-4691-bffc-0163d1624bb0 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:29.200452 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7ab051dd-d344-4691-bffc-0163d1624bb0 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:29.200881 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7ab051dd-d344-4691-bffc-0163d1624bb0 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:29.339973 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-7ab051dd-d344-4691-bffc-0163d1624bb0 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:29.344115 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-7ab051dd-d344-4691-bffc-0163d1624bb0 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91" status: 200 len: 1507 microversion: 2.1 time: 0.155780 Feb 16 14:28:29.345002 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 255/463] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:29 2022] GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91 => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:29.376442 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-48e4a90e-94e4-40d6-8684-78f5c0d4e98f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:29.377073 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-48e4a90e-94e4-40d6-8684-78f5c0d4e98f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:29.383812 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-48e4a90e-94e4-40d6-8684-78f5c0d4e98f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:29.384274 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-48e4a90e-94e4-40d6-8684-78f5c0d4e98f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:29.385073 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-48e4a90e-94e4-40d6-8684-78f5c0d4e98f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:29.385715 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-48e4a90e-94e4-40d6-8684-78f5c0d4e98f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:29.532667 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-48e4a90e-94e4-40d6-8684-78f5c0d4e98f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:29.536125 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-03285fc1-c643-482f-b1ef-a7a94085e36d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:29.538325 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-03285fc1-c643-482f-b1ef-a7a94085e36d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:29.545873 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-03285fc1-c643-482f-b1ef-a7a94085e36d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:29.546134 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-48e4a90e-94e4-40d6-8684-78f5c0d4e98f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:29.546407 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-03285fc1-c643-482f-b1ef-a7a94085e36d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:29.547342 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-03285fc1-c643-482f-b1ef-a7a94085e36d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:29.547891 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-03285fc1-c643-482f-b1ef-a7a94085e36d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:29.548016 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-48e4a90e-94e4-40d6-8684-78f5c0d4e98f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:29.549229 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-48e4a90e-94e4-40d6-8684-78f5c0d4e98f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1812 microversion: 2.20 time: 0.177574 Feb 16 14:28:29.549993 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 209/464] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:29 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1812 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:28:29.579476 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-03285fc1-c643-482f-b1ef-a7a94085e36d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054297 Feb 16 14:28:29.581178 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 256/465] 10.222.0.110 () {58 vars in 1306 bytes} [Wed Feb 16 14:28:29 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:28:30.371137 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6344154e-3153-4a33-a3d8-66a3c5b297a1 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:30.371849 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-6344154e-3153-4a33-a3d8-66a3c5b297a1 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: 897873de-9c9e-4336-b6c5-4bf241507c91] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:30.382054 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6344154e-3153-4a33-a3d8-66a3c5b297a1 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:30.382054 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6344154e-3153-4a33-a3d8-66a3c5b297a1 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:30.382862 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6344154e-3153-4a33-a3d8-66a3c5b297a1 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:30.383384 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6344154e-3153-4a33-a3d8-66a3c5b297a1 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:30.550037 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6344154e-3153-4a33-a3d8-66a3c5b297a1 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:30.557695 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-6344154e-3153-4a33-a3d8-66a3c5b297a1 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91" status: 200 len: 1507 microversion: 2.1 time: 0.190714 Feb 16 14:28:30.558457 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 210/466] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:30 2022] GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91 => generated 1507 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:28:30.568835 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-4f2f3d9c-731e-4d5f-91e4-53b39bae2651 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:30.569486 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-4f2f3d9c-731e-4d5f-91e4-53b39bae2651 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:30.576641 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4f2f3d9c-731e-4d5f-91e4-53b39bae2651 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:30.577251 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4f2f3d9c-731e-4d5f-91e4-53b39bae2651 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:30.579747 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4f2f3d9c-731e-4d5f-91e4-53b39bae2651 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:30.580190 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4f2f3d9c-731e-4d5f-91e4-53b39bae2651 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:30.595052 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ece98f70-7182-47c5-8bdd-635d913ee4ad tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:30.596071 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ece98f70-7182-47c5-8bdd-635d913ee4ad tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:30.602125 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ece98f70-7182-47c5-8bdd-635d913ee4ad tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:30.602684 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ece98f70-7182-47c5-8bdd-635d913ee4ad tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:30.603542 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ece98f70-7182-47c5-8bdd-635d913ee4ad tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:30.604042 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ece98f70-7182-47c5-8bdd-635d913ee4ad tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:30.660160 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ece98f70-7182-47c5-8bdd-635d913ee4ad tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069611 Feb 16 14:28:30.661159 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 211/467] 10.222.0.110 () {58 vars in 1306 bytes} [Wed Feb 16 14:28:30 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 14:28:30.763117 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-4f2f3d9c-731e-4d5f-91e4-53b39bae2651 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:30.774758 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-4f2f3d9c-731e-4d5f-91e4-53b39bae2651 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:30.776382 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-4f2f3d9c-731e-4d5f-91e4-53b39bae2651 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:30.777617 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-4f2f3d9c-731e-4d5f-91e4-53b39bae2651 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1812 microversion: 2.20 time: 0.213619 Feb 16 14:28:30.778273 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 257/468] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:30 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1812 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:28:31.574415 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-858f3190-ec44-475a-8811-20b7101ac109 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:31.575119 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-858f3190-ec44-475a-8811-20b7101ac109 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: 897873de-9c9e-4336-b6c5-4bf241507c91] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:31.582147 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-858f3190-ec44-475a-8811-20b7101ac109 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:31.582596 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-858f3190-ec44-475a-8811-20b7101ac109 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:31.583420 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-858f3190-ec44-475a-8811-20b7101ac109 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:31.583860 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-858f3190-ec44-475a-8811-20b7101ac109 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:31.673038 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-8d9f5fa8-b487-40d4-9eec-6961665f84ae tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:31.673545 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-8d9f5fa8-b487-40d4-9eec-6961665f84ae tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:31.683466 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8d9f5fa8-b487-40d4-9eec-6961665f84ae tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:31.683962 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8d9f5fa8-b487-40d4-9eec-6961665f84ae tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:31.684796 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8d9f5fa8-b487-40d4-9eec-6961665f84ae tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:31.685224 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8d9f5fa8-b487-40d4-9eec-6961665f84ae tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:31.723754 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-8d9f5fa8-b487-40d4-9eec-6961665f84ae tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056434 Feb 16 14:28:31.724529 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 258/469] 10.222.0.110 () {58 vars in 1306 bytes} [Wed Feb 16 14:28:31 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 14:28:31.750810 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-858f3190-ec44-475a-8811-20b7101ac109 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:31.760241 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-858f3190-ec44-475a-8811-20b7101ac109 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91" status: 200 len: 1507 microversion: 2.1 time: 0.189426 Feb 16 14:28:31.760819 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 212/470] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:31 2022] GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91 => generated 1507 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:31.796321 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-f45e7d6c-78e3-4a47-b30f-8956c559c643 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:31.797434 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-f45e7d6c-78e3-4a47-b30f-8956c559c643 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:31.803641 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f45e7d6c-78e3-4a47-b30f-8956c559c643 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:31.804091 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f45e7d6c-78e3-4a47-b30f-8956c559c643 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:31.804911 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f45e7d6c-78e3-4a47-b30f-8956c559c643 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:31.805543 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f45e7d6c-78e3-4a47-b30f-8956c559c643 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:31.953119 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-f45e7d6c-78e3-4a47-b30f-8956c559c643 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:31.962931 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-f45e7d6c-78e3-4a47-b30f-8956c559c643 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:31.964442 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-f45e7d6c-78e3-4a47-b30f-8956c559c643 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:31.965615 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-f45e7d6c-78e3-4a47-b30f-8956c559c643 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1812 microversion: 2.20 time: 0.173130 Feb 16 14:28:31.966201 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 259/471] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:31 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1812 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:28:32.736322 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-7128d14f-17f8-47ac-bf3e-92b742ba9a45 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:32.737260 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-7128d14f-17f8-47ac-bf3e-92b742ba9a45 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:32.743853 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7128d14f-17f8-47ac-bf3e-92b742ba9a45 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:32.744321 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7128d14f-17f8-47ac-bf3e-92b742ba9a45 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:32.745163 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7128d14f-17f8-47ac-bf3e-92b742ba9a45 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:32.745616 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7128d14f-17f8-47ac-bf3e-92b742ba9a45 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:32.776964 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-725e21a8-49d7-4845-ad04-9def5342973d tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:32.777565 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-725e21a8-49d7-4845-ad04-9def5342973d tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: 897873de-9c9e-4336-b6c5-4bf241507c91] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:32.780766 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-7128d14f-17f8-47ac-bf3e-92b742ba9a45 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048980 Feb 16 14:28:32.781360 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 213/472] 10.222.0.110 () {58 vars in 1306 bytes} [Wed Feb 16 14:28:32 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:28:32.783365 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-725e21a8-49d7-4845-ad04-9def5342973d tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:32.783842 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-725e21a8-49d7-4845-ad04-9def5342973d tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:32.784599 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-725e21a8-49d7-4845-ad04-9def5342973d tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:32.785063 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-725e21a8-49d7-4845-ad04-9def5342973d tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:32.925015 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-725e21a8-49d7-4845-ad04-9def5342973d tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:32.934548 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-725e21a8-49d7-4845-ad04-9def5342973d tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91" status: 200 len: 1507 microversion: 2.1 time: 0.161132 Feb 16 14:28:32.938676 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 260/473] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:32 2022] GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:28:32.985860 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-aaa2ea5a-387a-470a-86c8-4d9bef5e32b7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:32.986456 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-aaa2ea5a-387a-470a-86c8-4d9bef5e32b7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:32.992341 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-aaa2ea5a-387a-470a-86c8-4d9bef5e32b7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:32.992774 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-aaa2ea5a-387a-470a-86c8-4d9bef5e32b7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:32.993540 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-aaa2ea5a-387a-470a-86c8-4d9bef5e32b7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:32.993972 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-aaa2ea5a-387a-470a-86c8-4d9bef5e32b7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:33.145821 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-aaa2ea5a-387a-470a-86c8-4d9bef5e32b7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:33.154192 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-aaa2ea5a-387a-470a-86c8-4d9bef5e32b7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:33.156266 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-aaa2ea5a-387a-470a-86c8-4d9bef5e32b7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:33.157588 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-aaa2ea5a-387a-470a-86c8-4d9bef5e32b7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1812 microversion: 2.20 time: 0.175986 Feb 16 14:28:33.158169 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 214/474] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:32 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1812 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:28:33.792308 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-50e00f06-1181-47d6-9bfb-87612169dbeb tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:33.793317 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-50e00f06-1181-47d6-9bfb-87612169dbeb tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:33.799367 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-50e00f06-1181-47d6-9bfb-87612169dbeb tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:33.799815 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-50e00f06-1181-47d6-9bfb-87612169dbeb tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:33.800584 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-50e00f06-1181-47d6-9bfb-87612169dbeb tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:33.801021 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-50e00f06-1181-47d6-9bfb-87612169dbeb tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:33.831006 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-50e00f06-1181-47d6-9bfb-87612169dbeb tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042455 Feb 16 14:28:33.831559 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 261/475] 10.222.0.110 () {58 vars in 1306 bytes} [Wed Feb 16 14:28:33 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:28:33.953977 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-48ef5dfd-13bf-40d6-bfef-6da76f7550f2 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:33.956527 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-48ef5dfd-13bf-40d6-bfef-6da76f7550f2 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: 897873de-9c9e-4336-b6c5-4bf241507c91] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:33.960831 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-48ef5dfd-13bf-40d6-bfef-6da76f7550f2 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:33.961283 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-48ef5dfd-13bf-40d6-bfef-6da76f7550f2 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:33.962058 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-48ef5dfd-13bf-40d6-bfef-6da76f7550f2 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:33.962497 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-48ef5dfd-13bf-40d6-bfef-6da76f7550f2 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:34.108459 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-48ef5dfd-13bf-40d6-bfef-6da76f7550f2 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:34.116932 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-48ef5dfd-13bf-40d6-bfef-6da76f7550f2 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91" status: 200 len: 1507 microversion: 2.1 time: 0.167525 Feb 16 14:28:34.117543 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 215/476] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:33 2022] GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91 => generated 1507 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:34.182534 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-a5fcbc3c-6fdf-491d-94ce-05702ccd5190 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:34.182534 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-a5fcbc3c-6fdf-491d-94ce-05702ccd5190 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:34.183934 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a5fcbc3c-6fdf-491d-94ce-05702ccd5190 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:34.184583 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a5fcbc3c-6fdf-491d-94ce-05702ccd5190 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:34.185372 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a5fcbc3c-6fdf-491d-94ce-05702ccd5190 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:34.185812 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a5fcbc3c-6fdf-491d-94ce-05702ccd5190 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:34.328888 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-a5fcbc3c-6fdf-491d-94ce-05702ccd5190 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:34.338365 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-a5fcbc3c-6fdf-491d-94ce-05702ccd5190 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:34.340045 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-a5fcbc3c-6fdf-491d-94ce-05702ccd5190 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:34.341264 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-a5fcbc3c-6fdf-491d-94ce-05702ccd5190 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1812 microversion: 2.20 time: 0.167967 Feb 16 14:28:34.341899 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 262/477] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:34 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1812 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:28:34.842433 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-1928bc8a-d0d1-4a65-a0f1-e81a1cc4a537 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:34.843372 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-1928bc8a-d0d1-4a65-a0f1-e81a1cc4a537 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:34.849216 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1928bc8a-d0d1-4a65-a0f1-e81a1cc4a537 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:34.849681 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1928bc8a-d0d1-4a65-a0f1-e81a1cc4a537 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:34.850462 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1928bc8a-d0d1-4a65-a0f1-e81a1cc4a537 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:34.850934 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1928bc8a-d0d1-4a65-a0f1-e81a1cc4a537 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:34.879859 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-1928bc8a-d0d1-4a65-a0f1-e81a1cc4a537 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041180 Feb 16 14:28:34.885170 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 216/478] 10.222.0.110 () {58 vars in 1306 bytes} [Wed Feb 16 14:28:34 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 16 14:28:35.133160 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-a0843b64-381b-4e71-8724-6b23785f9619 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:35.133795 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-a0843b64-381b-4e71-8724-6b23785f9619 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: 897873de-9c9e-4336-b6c5-4bf241507c91] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:35.139975 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a0843b64-381b-4e71-8724-6b23785f9619 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:35.140763 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a0843b64-381b-4e71-8724-6b23785f9619 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:35.141658 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a0843b64-381b-4e71-8724-6b23785f9619 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:35.142097 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a0843b64-381b-4e71-8724-6b23785f9619 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:35.275557 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-a0843b64-381b-4e71-8724-6b23785f9619 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:35.283312 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-a0843b64-381b-4e71-8724-6b23785f9619 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91" status: 200 len: 1507 microversion: 2.1 time: 0.153935 Feb 16 14:28:35.284101 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 263/479] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:35 2022] GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:35.360973 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e19fe816-dce2-46c0-aa2d-e5a9804442dc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:35.361487 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-e19fe816-dce2-46c0-aa2d-e5a9804442dc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:35.367792 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e19fe816-dce2-46c0-aa2d-e5a9804442dc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:35.368245 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e19fe816-dce2-46c0-aa2d-e5a9804442dc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:35.369025 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e19fe816-dce2-46c0-aa2d-e5a9804442dc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:35.369463 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e19fe816-dce2-46c0-aa2d-e5a9804442dc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:35.511096 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-e19fe816-dce2-46c0-aa2d-e5a9804442dc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:35.519898 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-e19fe816-dce2-46c0-aa2d-e5a9804442dc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:35.521418 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-e19fe816-dce2-46c0-aa2d-e5a9804442dc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:35.522610 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-e19fe816-dce2-46c0-aa2d-e5a9804442dc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1812 microversion: 2.20 time: 0.166280 Feb 16 14:28:35.523194 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 217/480] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:35 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1812 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:28:36.301298 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-05ddb68d-9fb4-4f8a-99f1-903485f442bc tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:36.301940 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-05ddb68d-9fb4-4f8a-99f1-903485f442bc tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: 897873de-9c9e-4336-b6c5-4bf241507c91] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:36.307868 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-05ddb68d-9fb4-4f8a-99f1-903485f442bc tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:36.308317 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-05ddb68d-9fb4-4f8a-99f1-903485f442bc tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:36.309092 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-05ddb68d-9fb4-4f8a-99f1-903485f442bc tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:36.309521 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-05ddb68d-9fb4-4f8a-99f1-903485f442bc tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:36.457444 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-05ddb68d-9fb4-4f8a-99f1-903485f442bc tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:36.464874 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-05ddb68d-9fb4-4f8a-99f1-903485f442bc tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91" status: 200 len: 1507 microversion: 2.1 time: 0.167210 Feb 16 14:28:36.465440 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 264/481] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:36 2022] GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91 => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:36.541219 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-445d3e6f-3fcb-4b4e-acce-d901ac38fe09 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:36.541844 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-445d3e6f-3fcb-4b4e-acce-d901ac38fe09 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:36.549036 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-445d3e6f-3fcb-4b4e-acce-d901ac38fe09 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:36.549613 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-445d3e6f-3fcb-4b4e-acce-d901ac38fe09 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:36.550366 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-445d3e6f-3fcb-4b4e-acce-d901ac38fe09 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:36.550836 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-445d3e6f-3fcb-4b4e-acce-d901ac38fe09 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:36.691231 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-445d3e6f-3fcb-4b4e-acce-d901ac38fe09 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:36.712696 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-445d3e6f-3fcb-4b4e-acce-d901ac38fe09 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:36.712696 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-445d3e6f-3fcb-4b4e-acce-d901ac38fe09 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:36.712696 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-445d3e6f-3fcb-4b4e-acce-d901ac38fe09 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1812 microversion: 2.20 time: 0.171613 Feb 16 14:28:36.713104 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 218/482] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:36 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1812 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:28:36.808800 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-a063e929-3bee-48c1-8171-549ec97a2fef tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:36.809298 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-a063e929-3bee-48c1-8171-549ec97a2fef tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: d86c93ea-a9ad-4b0c-bc25-18f3da5bb813] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:36.816001 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a063e929-3bee-48c1-8171-549ec97a2fef tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:36.816444 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a063e929-3bee-48c1-8171-549ec97a2fef tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:36.817220 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a063e929-3bee-48c1-8171-549ec97a2fef tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:36.817651 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a063e929-3bee-48c1-8171-549ec97a2fef tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:36.841610 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-a063e929-3bee-48c1-8171-549ec97a2fef tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: d86c93ea-a9ad-4b0c-bc25-18f3da5bb813] Going to try to terminate instance {{(pid=117031) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 16 14:28:37.113335 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-a063e929-3bee-48c1-8171-549ec97a2fef tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "DELETE /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813" status: 204 len: 0 microversion: 2.1 time: 0.307432 Feb 16 14:28:37.113944 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 265/483] 10.222.0.110 () {58 vars in 1243 bytes} [Wed Feb 16 14:28:36 2022] DELETE /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 16 14:28:37.121870 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-314a63de-7d3e-484d-aa02-916dabfb76fe tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:37.122478 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-314a63de-7d3e-484d-aa02-916dabfb76fe tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: d86c93ea-a9ad-4b0c-bc25-18f3da5bb813] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:37.129003 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-314a63de-7d3e-484d-aa02-916dabfb76fe tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:37.129454 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-314a63de-7d3e-484d-aa02-916dabfb76fe tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:37.130284 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-314a63de-7d3e-484d-aa02-916dabfb76fe tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:37.130910 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-314a63de-7d3e-484d-aa02-916dabfb76fe tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:37.275500 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-314a63de-7d3e-484d-aa02-916dabfb76fe tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:37.283389 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-314a63de-7d3e-484d-aa02-916dabfb76fe tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813" status: 200 len: 1519 microversion: 2.1 time: 0.165146 Feb 16 14:28:37.283983 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 219/484] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:37 2022] GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:37.482703 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-fe1b5727-4eea-4eb8-980c-745028bd205c tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:37.483436 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-fe1b5727-4eea-4eb8-980c-745028bd205c tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: 897873de-9c9e-4336-b6c5-4bf241507c91] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:37.489707 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-fe1b5727-4eea-4eb8-980c-745028bd205c tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:37.490156 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-fe1b5727-4eea-4eb8-980c-745028bd205c tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:37.490962 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-fe1b5727-4eea-4eb8-980c-745028bd205c tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:37.491395 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-fe1b5727-4eea-4eb8-980c-745028bd205c tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:37.623205 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-fe1b5727-4eea-4eb8-980c-745028bd205c tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:37.631067 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-fe1b5727-4eea-4eb8-980c-745028bd205c tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91" status: 200 len: 1507 microversion: 2.1 time: 0.152516 Feb 16 14:28:37.631635 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 266/485] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:37 2022] GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:37.726121 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-846f9a38-388c-4009-b6d0-469ce50df0e7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:37.726761 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-846f9a38-388c-4009-b6d0-469ce50df0e7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:37.733588 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-846f9a38-388c-4009-b6d0-469ce50df0e7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:37.734054 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-846f9a38-388c-4009-b6d0-469ce50df0e7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:37.735076 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-846f9a38-388c-4009-b6d0-469ce50df0e7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:37.735622 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-846f9a38-388c-4009-b6d0-469ce50df0e7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:37.965587 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-846f9a38-388c-4009-b6d0-469ce50df0e7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:37.974298 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-846f9a38-388c-4009-b6d0-469ce50df0e7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:37.975843 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-846f9a38-388c-4009-b6d0-469ce50df0e7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:37.977045 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-846f9a38-388c-4009-b6d0-469ce50df0e7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1812 microversion: 2.20 time: 0.254606 Feb 16 14:28:37.977615 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 220/486] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:37 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1812 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:28:38.291598 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-90dc190a-cdc0-4ed8-8c22-24f2a99409fc req-7d2865c2-bbc5-42f9-933d-803631300ac2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "897873de-9c9e-4336-b6c5-4bf241507c91", "name": "network-vif-deleted", "tag": "f11a2a7a-f280-4d5e-8f52-d78dce060a80"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:28:38.293117 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:28:38.293117 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:28:38.302219 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-3e6ebef1-79d0-40ea-9bc5-30aea4c30ac6 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:38.308477 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-3e6ebef1-79d0-40ea-9bc5-30aea4c30ac6 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: d86c93ea-a9ad-4b0c-bc25-18f3da5bb813] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:38.308606 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-90dc190a-cdc0-4ed8-8c22-24f2a99409fc req-7d2865c2-bbc5-42f9-933d-803631300ac2 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:38.308606 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-90dc190a-cdc0-4ed8-8c22-24f2a99409fc req-7d2865c2-bbc5-42f9-933d-803631300ac2 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:38.309664 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3e6ebef1-79d0-40ea-9bc5-30aea4c30ac6 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:38.310124 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3e6ebef1-79d0-40ea-9bc5-30aea4c30ac6 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:38.310989 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3e6ebef1-79d0-40ea-9bc5-30aea4c30ac6 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:38.311440 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3e6ebef1-79d0-40ea-9bc5-30aea4c30ac6 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:38.319820 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-90dc190a-cdc0-4ed8-8c22-24f2a99409fc req-7d2865c2-bbc5-42f9-933d-803631300ac2 service nova] Creating event network-vif-deleted:f11a2a7a-f280-4d5e-8f52-d78dce060a80 for instance 897873de-9c9e-4336-b6c5-4bf241507c91 on hv-cinder-80473 Feb 16 14:28:38.324687 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-90dc190a-cdc0-4ed8-8c22-24f2a99409fc req-7d2865c2-bbc5-42f9-933d-803631300ac2 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036862 Feb 16 14:28:38.325269 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 267/487] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:28:38.450386 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-879991b2-89cd-4a75-9c9d-a1febce9bbc8 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:38.450531 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3e6ebef1-79d0-40ea-9bc5-30aea4c30ac6 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:38.451005 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-879991b2-89cd-4a75-9c9d-a1febce9bbc8 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:38.458298 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-879991b2-89cd-4a75-9c9d-a1febce9bbc8 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:38.458779 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-879991b2-89cd-4a75-9c9d-a1febce9bbc8 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:38.458987 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-3e6ebef1-79d0-40ea-9bc5-30aea4c30ac6 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813" status: 200 len: 1519 microversion: 2.1 time: 0.160795 Feb 16 14:28:38.463385 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 221/488] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:38 2022] GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:38.463507 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-879991b2-89cd-4a75-9c9d-a1febce9bbc8 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:38.463507 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-879991b2-89cd-4a75-9c9d-a1febce9bbc8 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:38.484691 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-879991b2-89cd-4a75-9c9d-a1febce9bbc8 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Going to try to terminate instance {{(pid=117031) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 16 14:28:38.647541 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b50afd32-32e7-4aa0-949f-d4ba4c0e6858 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:38.648145 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b50afd32-32e7-4aa0-949f-d4ba4c0e6858 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: 897873de-9c9e-4336-b6c5-4bf241507c91] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:38.654248 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b50afd32-32e7-4aa0-949f-d4ba4c0e6858 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:38.654742 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b50afd32-32e7-4aa0-949f-d4ba4c0e6858 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:38.655599 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b50afd32-32e7-4aa0-949f-d4ba4c0e6858 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:38.656285 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b50afd32-32e7-4aa0-949f-d4ba4c0e6858 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:38.718651 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b50afd32-32e7-4aa0-949f-d4ba4c0e6858 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:38.727368 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b50afd32-32e7-4aa0-949f-d4ba4c0e6858 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91" status: 200 len: 1302 microversion: 2.1 time: 0.083359 Feb 16 14:28:38.728072 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 222/489] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:38 2022] GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91 => generated 1302 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:38.875683 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-879991b2-89cd-4a75-9c9d-a1febce9bbc8 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "DELETE /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 204 len: 0 microversion: 2.1 time: 0.428252 Feb 16 14:28:38.876613 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 268/490] 10.222.0.110 () {58 vars in 1243 bytes} [Wed Feb 16 14:28:38 2022] DELETE /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 16 14:28:38.886658 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-dfe9b307-0df4-416e-ac1e-e45fc094b13c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:38.887558 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-dfe9b307-0df4-416e-ac1e-e45fc094b13c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:38.895355 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dfe9b307-0df4-416e-ac1e-e45fc094b13c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:38.895812 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dfe9b307-0df4-416e-ac1e-e45fc094b13c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:38.896609 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dfe9b307-0df4-416e-ac1e-e45fc094b13c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:38.897170 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dfe9b307-0df4-416e-ac1e-e45fc094b13c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:38.995875 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-dd72f613-f448-4035-846e-6501b0f634a1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:38.996842 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-dd72f613-f448-4035-846e-6501b0f634a1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:39.006085 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-dd72f613-f448-4035-846e-6501b0f634a1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:39.008215 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-dd72f613-f448-4035-846e-6501b0f634a1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:39.008215 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-dd72f613-f448-4035-846e-6501b0f634a1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:39.008215 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-dd72f613-f448-4035-846e-6501b0f634a1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:39.035427 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-dfe9b307-0df4-416e-ac1e-e45fc094b13c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:39.042998 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-dfe9b307-0df4-416e-ac1e-e45fc094b13c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1511 microversion: 2.1 time: 0.160250 Feb 16 14:28:39.043593 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 223/491] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:38 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:28:39.163748 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-dd72f613-f448-4035-846e-6501b0f634a1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:39.173847 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-dd72f613-f448-4035-846e-6501b0f634a1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:39.175393 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-dd72f613-f448-4035-846e-6501b0f634a1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:39.176572 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-dd72f613-f448-4035-846e-6501b0f634a1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1812 microversion: 2.20 time: 0.184754 Feb 16 14:28:39.177141 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 269/492] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:38 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1812 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:28:39.478266 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-51eac752-818a-4ee8-95da-f83b818d6ec7 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:39.478890 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-51eac752-818a-4ee8-95da-f83b818d6ec7 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: d86c93ea-a9ad-4b0c-bc25-18f3da5bb813] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:39.485622 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-51eac752-818a-4ee8-95da-f83b818d6ec7 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:39.486015 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-51eac752-818a-4ee8-95da-f83b818d6ec7 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:39.486841 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-51eac752-818a-4ee8-95da-f83b818d6ec7 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:39.487285 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-51eac752-818a-4ee8-95da-f83b818d6ec7 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:39.746160 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-32c803d8-f800-4bc6-be92-c4ee78f0fb09 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:39.747412 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-32c803d8-f800-4bc6-be92-c4ee78f0fb09 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: 897873de-9c9e-4336-b6c5-4bf241507c91] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:39.754320 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-32c803d8-f800-4bc6-be92-c4ee78f0fb09 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:39.755119 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-32c803d8-f800-4bc6-be92-c4ee78f0fb09 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:39.755674 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-32c803d8-f800-4bc6-be92-c4ee78f0fb09 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:39.756226 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-32c803d8-f800-4bc6-be92-c4ee78f0fb09 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:39.786760 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-32c803d8-f800-4bc6-be92-c4ee78f0fb09 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:39.787186 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-32c803d8-f800-4bc6-be92-c4ee78f0fb09 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:39.787664 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.objects.instance [None req-32c803d8-f800-4bc6-be92-c4ee78f0fb09 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lazy-loading 'fault' on Instance uuid 897873de-9c9e-4336-b6c5-4bf241507c91 {{(pid=117031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:28:39.826827 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-32c803d8-f800-4bc6-be92-c4ee78f0fb09 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642800fd0f7b4d5faa698f594b493bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d3028599f374f01812a61120701fb2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:39.835062 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-51eac752-818a-4ee8-95da-f83b818d6ec7 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:39.836130 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-32c803d8-f800-4bc6-be92-c4ee78f0fb09 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91" status: 200 len: 1307 microversion: 2.1 time: 0.093804 Feb 16 14:28:39.836715 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 270/493] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:39 2022] GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91 => generated 1307 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:28:39.842422 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-51eac752-818a-4ee8-95da-f83b818d6ec7 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813" status: 200 len: 1519 microversion: 2.1 time: 0.367904 Feb 16 14:28:39.843544 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 224/494] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:39 2022] GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813 => generated 1519 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:40.060803 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-c9b7bbd9-1628-4464-8f61-f8d2ca04ba78 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:40.061406 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-c9b7bbd9-1628-4464-8f61-f8d2ca04ba78 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:40.067325 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c9b7bbd9-1628-4464-8f61-f8d2ca04ba78 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:40.067771 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c9b7bbd9-1628-4464-8f61-f8d2ca04ba78 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:40.068537 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c9b7bbd9-1628-4464-8f61-f8d2ca04ba78 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:40.068964 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c9b7bbd9-1628-4464-8f61-f8d2ca04ba78 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:40.199109 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-5330d7d6-4a3b-4f0c-83e3-e7fed2497f50 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:40.200212 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-5330d7d6-4a3b-4f0c-83e3-e7fed2497f50 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:40.209353 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5330d7d6-4a3b-4f0c-83e3-e7fed2497f50 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:40.209807 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5330d7d6-4a3b-4f0c-83e3-e7fed2497f50 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:40.210173 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-c9b7bbd9-1628-4464-8f61-f8d2ca04ba78 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:40.210612 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5330d7d6-4a3b-4f0c-83e3-e7fed2497f50 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:40.211087 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5330d7d6-4a3b-4f0c-83e3-e7fed2497f50 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:40.217676 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-c9b7bbd9-1628-4464-8f61-f8d2ca04ba78 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1511 microversion: 2.1 time: 0.160850 Feb 16 14:28:40.219020 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 271/495] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:40 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:40.346199 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-5330d7d6-4a3b-4f0c-83e3-e7fed2497f50 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:40.354448 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-5330d7d6-4a3b-4f0c-83e3-e7fed2497f50 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:40.356003 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-5330d7d6-4a3b-4f0c-83e3-e7fed2497f50 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:40.357155 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-5330d7d6-4a3b-4f0c-83e3-e7fed2497f50 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1812 microversion: 2.20 time: 0.161936 Feb 16 14:28:40.357723 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 225/496] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:40 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1812 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:28:40.853908 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-9be7370e-e88c-4c03-a7aa-5063e1b59542 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:40.854517 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-9be7370e-e88c-4c03-a7aa-5063e1b59542 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] [instance: 897873de-9c9e-4336-b6c5-4bf241507c91] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:40.859503 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-59c65226-edf4-4785-a1b7-d066dc9ef28b tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:40.860111 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-59c65226-edf4-4785-a1b7-d066dc9ef28b tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: d86c93ea-a9ad-4b0c-bc25-18f3da5bb813] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:40.860771 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9be7370e-e88c-4c03-a7aa-5063e1b59542 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:40.861227 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9be7370e-e88c-4c03-a7aa-5063e1b59542 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:40.862009 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9be7370e-e88c-4c03-a7aa-5063e1b59542 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:40.862441 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9be7370e-e88c-4c03-a7aa-5063e1b59542 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:40.865993 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-59c65226-edf4-4785-a1b7-d066dc9ef28b tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:40.866449 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-59c65226-edf4-4785-a1b7-d066dc9ef28b tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:40.867274 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-59c65226-edf4-4785-a1b7-d066dc9ef28b tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:40.867714 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-59c65226-edf4-4785-a1b7-d066dc9ef28b tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:40.876347 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.wsgi [None req-9be7370e-e88c-4c03-a7aa-5063e1b59542 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] HTTP exception thrown: Instance 897873de-9c9e-4336-b6c5-4bf241507c91 could not be found. Feb 16 14:28:40.876943 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-9be7370e-e88c-4c03-a7aa-5063e1b59542 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] Returning 404 to user: Instance 897873de-9c9e-4336-b6c5-4bf241507c91 could not be found. {{(pid=117031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:28:40.877768 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-9be7370e-e88c-4c03-a7aa-5063e1b59542 tempest-VolumesActionsTest-146552768 tempest-VolumesActionsTest-146552768-project] 10.222.0.110 "GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91" status: 404 len: 111 microversion: 2.1 time: 0.027665 Feb 16 14:28:40.878313 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 272/497] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:40 2022] GET /compute/v2.1/servers/897873de-9c9e-4336-b6c5-4bf241507c91 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 14:28:41.014443 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-59c65226-edf4-4785-a1b7-d066dc9ef28b tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:41.021904 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-59c65226-edf4-4785-a1b7-d066dc9ef28b tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813" status: 200 len: 1519 microversion: 2.1 time: 0.165961 Feb 16 14:28:41.034746 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 226/498] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:40 2022] GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:28:41.235481 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-c9e95868-c690-4808-8a0a-ed502303f8ea tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:41.236298 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-c9e95868-c690-4808-8a0a-ed502303f8ea tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:41.242689 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c9e95868-c690-4808-8a0a-ed502303f8ea tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:41.243150 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c9e95868-c690-4808-8a0a-ed502303f8ea tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:41.243936 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c9e95868-c690-4808-8a0a-ed502303f8ea tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:41.244372 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c9e95868-c690-4808-8a0a-ed502303f8ea tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:41.375485 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-1b18a105-d225-40d3-adc7-31b2af7006e6 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:41.375753 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-1b18a105-d225-40d3-adc7-31b2af7006e6 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:41.382720 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1b18a105-d225-40d3-adc7-31b2af7006e6 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:41.383484 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1b18a105-d225-40d3-adc7-31b2af7006e6 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:41.384458 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1b18a105-d225-40d3-adc7-31b2af7006e6 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:41.385058 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1b18a105-d225-40d3-adc7-31b2af7006e6 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:41.395191 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-c9e95868-c690-4808-8a0a-ed502303f8ea tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:41.408543 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-c9e95868-c690-4808-8a0a-ed502303f8ea tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1511 microversion: 2.1 time: 0.176865 Feb 16 14:28:41.410895 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 273/499] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:41 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1511 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:41.622915 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-1b18a105-d225-40d3-adc7-31b2af7006e6 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:41.648554 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-1b18a105-d225-40d3-adc7-31b2af7006e6 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:41.648554 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-1b18a105-d225-40d3-adc7-31b2af7006e6 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:41.648554 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-1b18a105-d225-40d3-adc7-31b2af7006e6 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1812 microversion: 2.20 time: 0.273689 Feb 16 14:28:41.648895 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 227/500] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:41 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1812 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:28:41.875900 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-ad6e5ac0-b7e6-4a6f-9561-2d64ea61bc66 req-d06141a4-f6f5-4336-9f4f-96354abad8c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d86c93ea-a9ad-4b0c-bc25-18f3da5bb813", "name": "network-vif-deleted", "tag": "0bb1f89d-e659-4b77-826a-fe2b1eebc599"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:28:41.877467 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:28:41.877467 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:28:41.885083 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-ad6e5ac0-b7e6-4a6f-9561-2d64ea61bc66 req-d06141a4-f6f5-4336-9f4f-96354abad8c0 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:41.885516 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-ad6e5ac0-b7e6-4a6f-9561-2d64ea61bc66 req-d06141a4-f6f5-4336-9f4f-96354abad8c0 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:41.896531 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-ad6e5ac0-b7e6-4a6f-9561-2d64ea61bc66 req-d06141a4-f6f5-4336-9f4f-96354abad8c0 service nova] Creating event network-vif-deleted:0bb1f89d-e659-4b77-826a-fe2b1eebc599 for instance d86c93ea-a9ad-4b0c-bc25-18f3da5bb813 on hv-cinder-80473 Feb 16 14:28:41.901562 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-ad6e5ac0-b7e6-4a6f-9561-2d64ea61bc66 req-d06141a4-f6f5-4336-9f4f-96354abad8c0 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029940 Feb 16 14:28:41.902132 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 274/501] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:28:42.050044 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-52724773-a5ab-4299-a51e-d39bb8bcf5e4 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:42.052978 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-52724773-a5ab-4299-a51e-d39bb8bcf5e4 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: d86c93ea-a9ad-4b0c-bc25-18f3da5bb813] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:42.056638 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-52724773-a5ab-4299-a51e-d39bb8bcf5e4 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:42.057085 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-52724773-a5ab-4299-a51e-d39bb8bcf5e4 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:42.057851 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-52724773-a5ab-4299-a51e-d39bb8bcf5e4 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:42.058332 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-52724773-a5ab-4299-a51e-d39bb8bcf5e4 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:42.122339 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-52724773-a5ab-4299-a51e-d39bb8bcf5e4 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:42.130125 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-52724773-a5ab-4299-a51e-d39bb8bcf5e4 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813" status: 200 len: 1308 microversion: 2.1 time: 0.084760 Feb 16 14:28:42.130812 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 228/502] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:42 2022] GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813 => generated 1308 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:42.426907 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-585ce946-92e5-4e44-b7b2-3fc4bf5a4ed6 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:42.427728 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-585ce946-92e5-4e44-b7b2-3fc4bf5a4ed6 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:42.433751 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-585ce946-92e5-4e44-b7b2-3fc4bf5a4ed6 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:42.434206 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-585ce946-92e5-4e44-b7b2-3fc4bf5a4ed6 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:42.435113 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-585ce946-92e5-4e44-b7b2-3fc4bf5a4ed6 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:42.435518 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-585ce946-92e5-4e44-b7b2-3fc4bf5a4ed6 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:42.571158 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-585ce946-92e5-4e44-b7b2-3fc4bf5a4ed6 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:42.579601 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-585ce946-92e5-4e44-b7b2-3fc4bf5a4ed6 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1511 microversion: 2.1 time: 0.157271 Feb 16 14:28:42.580166 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 275/503] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:42 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:42.664983 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-2c60c006-5301-4b9a-a950-e55fc7645e4d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:42.665585 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-2c60c006-5301-4b9a-a950-e55fc7645e4d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:42.673411 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2c60c006-5301-4b9a-a950-e55fc7645e4d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:42.673857 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2c60c006-5301-4b9a-a950-e55fc7645e4d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:42.674669 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2c60c006-5301-4b9a-a950-e55fc7645e4d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:42.675113 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2c60c006-5301-4b9a-a950-e55fc7645e4d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:42.817354 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-2c60c006-5301-4b9a-a950-e55fc7645e4d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:42.826092 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-2c60c006-5301-4b9a-a950-e55fc7645e4d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:42.828818 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-2c60c006-5301-4b9a-a950-e55fc7645e4d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:42.830262 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-2c60c006-5301-4b9a-a950-e55fc7645e4d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1812 microversion: 2.20 time: 0.169094 Feb 16 14:28:42.830868 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 229/504] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:42 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1812 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:28:43.147085 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-283d3b84-9f2b-42fb-b7fc-adb5728c9cdd tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:43.147608 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-283d3b84-9f2b-42fb-b7fc-adb5728c9cdd tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: d86c93ea-a9ad-4b0c-bc25-18f3da5bb813] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:43.153542 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-283d3b84-9f2b-42fb-b7fc-adb5728c9cdd tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:43.153981 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-283d3b84-9f2b-42fb-b7fc-adb5728c9cdd tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:43.154787 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-283d3b84-9f2b-42fb-b7fc-adb5728c9cdd tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:43.155215 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-283d3b84-9f2b-42fb-b7fc-adb5728c9cdd tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:43.183932 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-283d3b84-9f2b-42fb-b7fc-adb5728c9cdd tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:43.184366 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-283d3b84-9f2b-42fb-b7fc-adb5728c9cdd tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:43.184802 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.objects.instance [None req-283d3b84-9f2b-42fb-b7fc-adb5728c9cdd tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lazy-loading 'fault' on Instance uuid d86c93ea-a9ad-4b0c-bc25-18f3da5bb813 {{(pid=117031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:28:43.224106 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-283d3b84-9f2b-42fb-b7fc-adb5728c9cdd tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:43.231656 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-283d3b84-9f2b-42fb-b7fc-adb5728c9cdd tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813" status: 200 len: 1313 microversion: 2.1 time: 0.088296 Feb 16 14:28:43.232246 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 276/505] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:43 2022] GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813 => generated 1313 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:43.597058 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-d497c9db-8ed3-4053-b9ba-fec3c2501c75 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:43.597655 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-d497c9db-8ed3-4053-b9ba-fec3c2501c75 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:43.603755 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d497c9db-8ed3-4053-b9ba-fec3c2501c75 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:43.604207 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d497c9db-8ed3-4053-b9ba-fec3c2501c75 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:43.604989 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d497c9db-8ed3-4053-b9ba-fec3c2501c75 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:43.605425 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d497c9db-8ed3-4053-b9ba-fec3c2501c75 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:43.741789 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d497c9db-8ed3-4053-b9ba-fec3c2501c75 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:43.749301 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-d497c9db-8ed3-4053-b9ba-fec3c2501c75 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1511 microversion: 2.1 time: 0.156343 Feb 16 14:28:43.749976 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 230/506] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:43 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:43.849185 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-9ef4fd6d-0ed5-4813-8a2e-6ee49796da2e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:43.849839 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-9ef4fd6d-0ed5-4813-8a2e-6ee49796da2e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:43.855501 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9ef4fd6d-0ed5-4813-8a2e-6ee49796da2e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:43.856059 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9ef4fd6d-0ed5-4813-8a2e-6ee49796da2e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:43.856830 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9ef4fd6d-0ed5-4813-8a2e-6ee49796da2e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:43.857253 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9ef4fd6d-0ed5-4813-8a2e-6ee49796da2e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:43.992134 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-9ef4fd6d-0ed5-4813-8a2e-6ee49796da2e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:44.000610 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-9ef4fd6d-0ed5-4813-8a2e-6ee49796da2e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:44.002117 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-9ef4fd6d-0ed5-4813-8a2e-6ee49796da2e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:44.003302 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-9ef4fd6d-0ed5-4813-8a2e-6ee49796da2e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1812 microversion: 2.20 time: 0.157860 Feb 16 14:28:44.003869 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 277/507] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:43 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1812 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:28:44.248304 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e6b99832-a3c5-4a1b-abf8-2d543e9c1678 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:44.248919 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-e6b99832-a3c5-4a1b-abf8-2d543e9c1678 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: d86c93ea-a9ad-4b0c-bc25-18f3da5bb813] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:44.258544 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e6b99832-a3c5-4a1b-abf8-2d543e9c1678 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:44.259041 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e6b99832-a3c5-4a1b-abf8-2d543e9c1678 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:44.259850 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e6b99832-a3c5-4a1b-abf8-2d543e9c1678 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:44.260281 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e6b99832-a3c5-4a1b-abf8-2d543e9c1678 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:44.291320 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e6b99832-a3c5-4a1b-abf8-2d543e9c1678 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:44.291794 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e6b99832-a3c5-4a1b-abf8-2d543e9c1678 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:44.292242 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-e6b99832-a3c5-4a1b-abf8-2d543e9c1678 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lazy-loading 'fault' on Instance uuid d86c93ea-a9ad-4b0c-bc25-18f3da5bb813 {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:28:44.334050 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-e6b99832-a3c5-4a1b-abf8-2d543e9c1678 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:44.344649 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-e6b99832-a3c5-4a1b-abf8-2d543e9c1678 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813" status: 200 len: 1313 microversion: 2.1 time: 0.096553 Feb 16 14:28:44.354766 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 231/508] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:44 2022] GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813 => generated 1313 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:44.765395 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-fbd3090e-6bdf-427d-be62-5b239ffd55ec tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:44.765929 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-fbd3090e-6bdf-427d-be62-5b239ffd55ec tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:44.771770 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-fbd3090e-6bdf-427d-be62-5b239ffd55ec tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:44.772218 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-fbd3090e-6bdf-427d-be62-5b239ffd55ec tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:44.773055 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-fbd3090e-6bdf-427d-be62-5b239ffd55ec tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:44.773488 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-fbd3090e-6bdf-427d-be62-5b239ffd55ec tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:44.904258 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-fbd3090e-6bdf-427d-be62-5b239ffd55ec tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:44.911650 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-fbd3090e-6bdf-427d-be62-5b239ffd55ec tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1511 microversion: 2.1 time: 0.150285 Feb 16 14:28:44.912240 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 278/509] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:44 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1511 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:45.021291 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-702c2a03-c534-4092-9000-d16b13f05111 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:45.021890 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-702c2a03-c534-4092-9000-d16b13f05111 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:45.027709 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-702c2a03-c534-4092-9000-d16b13f05111 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:45.028155 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-702c2a03-c534-4092-9000-d16b13f05111 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:45.028921 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-702c2a03-c534-4092-9000-d16b13f05111 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:45.029357 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-702c2a03-c534-4092-9000-d16b13f05111 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:45.163599 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-702c2a03-c534-4092-9000-d16b13f05111 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:45.172603 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-702c2a03-c534-4092-9000-d16b13f05111 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:45.174114 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-702c2a03-c534-4092-9000-d16b13f05111 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:45.175368 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-702c2a03-c534-4092-9000-d16b13f05111 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1812 microversion: 2.20 time: 0.157932 Feb 16 14:28:45.175930 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 232/510] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:45 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1812 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:28:45.252089 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 16 14:28:45.252254 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: Wed Feb 16 14:28:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 16 14:28:45.361808 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-d5c92d34-376b-49ca-b491-949703c4fe56 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:45.362390 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-d5c92d34-376b-49ca-b491-949703c4fe56 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: d86c93ea-a9ad-4b0c-bc25-18f3da5bb813] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:45.368760 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d5c92d34-376b-49ca-b491-949703c4fe56 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:45.369217 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d5c92d34-376b-49ca-b491-949703c4fe56 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:45.370135 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d5c92d34-376b-49ca-b491-949703c4fe56 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:45.370578 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d5c92d34-376b-49ca-b491-949703c4fe56 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:45.403111 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d5c92d34-376b-49ca-b491-949703c4fe56 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:45.403564 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d5c92d34-376b-49ca-b491-949703c4fe56 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:45.404021 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.objects.instance [None req-d5c92d34-376b-49ca-b491-949703c4fe56 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lazy-loading 'fault' on Instance uuid d86c93ea-a9ad-4b0c-bc25-18f3da5bb813 {{(pid=117031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:28:45.446582 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-d5c92d34-376b-49ca-b491-949703c4fe56 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:45.455210 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-d5c92d34-376b-49ca-b491-949703c4fe56 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813" status: 200 len: 1313 microversion: 2.1 time: 0.097816 Feb 16 14:28:45.455769 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 279/511] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:45 2022] GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813 => generated 1313 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:45.927897 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-9f8999d0-bc9d-4ad9-b44c-a4c455435a38 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:45.928563 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-9f8999d0-bc9d-4ad9-b44c-a4c455435a38 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:45.935018 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9f8999d0-bc9d-4ad9-b44c-a4c455435a38 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:45.935484 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9f8999d0-bc9d-4ad9-b44c-a4c455435a38 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:45.936238 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9f8999d0-bc9d-4ad9-b44c-a4c455435a38 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:45.937194 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9f8999d0-bc9d-4ad9-b44c-a4c455435a38 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:46.073228 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-9f8999d0-bc9d-4ad9-b44c-a4c455435a38 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:46.082192 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-9f8999d0-bc9d-4ad9-b44c-a4c455435a38 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1511 microversion: 2.1 time: 0.158023 Feb 16 14:28:46.082988 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 233/512] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:45 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:28:46.194569 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-8f69b631-deb4-4ad1-bad5-55d1c5f95fc9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:46.195208 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-8f69b631-deb4-4ad1-bad5-55d1c5f95fc9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:46.202391 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8f69b631-deb4-4ad1-bad5-55d1c5f95fc9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:46.203945 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8f69b631-deb4-4ad1-bad5-55d1c5f95fc9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:46.205130 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8f69b631-deb4-4ad1-bad5-55d1c5f95fc9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:46.207705 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8f69b631-deb4-4ad1-bad5-55d1c5f95fc9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:46.343766 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-8f69b631-deb4-4ad1-bad5-55d1c5f95fc9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:46.352908 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-8f69b631-deb4-4ad1-bad5-55d1c5f95fc9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:46.354649 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-8f69b631-deb4-4ad1-bad5-55d1c5f95fc9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:46.356056 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-8f69b631-deb4-4ad1-bad5-55d1c5f95fc9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1812 microversion: 2.20 time: 0.165303 Feb 16 14:28:46.356728 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 280/513] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:46 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1812 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:28:46.472729 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f3418f6c-b72d-4ac8-a34e-36adee54a318 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:46.474580 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f3418f6c-b72d-4ac8-a34e-36adee54a318 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: d86c93ea-a9ad-4b0c-bc25-18f3da5bb813] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:46.481392 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f3418f6c-b72d-4ac8-a34e-36adee54a318 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:46.482009 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f3418f6c-b72d-4ac8-a34e-36adee54a318 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:46.482982 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f3418f6c-b72d-4ac8-a34e-36adee54a318 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:46.483908 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f3418f6c-b72d-4ac8-a34e-36adee54a318 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:46.503452 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-f3418f6c-b72d-4ac8-a34e-36adee54a318 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] HTTP exception thrown: Instance d86c93ea-a9ad-4b0c-bc25-18f3da5bb813 could not be found. Feb 16 14:28:46.504190 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f3418f6c-b72d-4ac8-a34e-36adee54a318 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Returning 404 to user: Instance d86c93ea-a9ad-4b0c-bc25-18f3da5bb813 could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:28:46.506980 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f3418f6c-b72d-4ac8-a34e-36adee54a318 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813" status: 404 len: 111 microversion: 2.1 time: 0.037199 Feb 16 14:28:46.506980 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 234/514] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:46 2022] GET /compute/v2.1/servers/d86c93ea-a9ad-4b0c-bc25-18f3da5bb813 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 14:28:47.099941 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-d2b08858-3792-4663-8a42-13a21732f91c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:47.100568 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-d2b08858-3792-4663-8a42-13a21732f91c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:47.106787 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d2b08858-3792-4663-8a42-13a21732f91c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:47.107237 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d2b08858-3792-4663-8a42-13a21732f91c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:47.108018 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d2b08858-3792-4663-8a42-13a21732f91c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:47.109063 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d2b08858-3792-4663-8a42-13a21732f91c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:47.276217 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-d2b08858-3792-4663-8a42-13a21732f91c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:47.285155 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-d2b08858-3792-4663-8a42-13a21732f91c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1511 microversion: 2.1 time: 0.189421 Feb 16 14:28:47.287811 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 281/515] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:47 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1511 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:47.376199 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-cd692370-5152-47b9-ba6d-06c80c0baac4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:47.376809 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-cd692370-5152-47b9-ba6d-06c80c0baac4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:47.382657 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cd692370-5152-47b9-ba6d-06c80c0baac4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:47.383301 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cd692370-5152-47b9-ba6d-06c80c0baac4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:47.387163 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cd692370-5152-47b9-ba6d-06c80c0baac4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:47.387600 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cd692370-5152-47b9-ba6d-06c80c0baac4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:47.637205 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-cd692370-5152-47b9-ba6d-06c80c0baac4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:47.645760 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-cd692370-5152-47b9-ba6d-06c80c0baac4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:47.647475 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-cd692370-5152-47b9-ba6d-06c80c0baac4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:47.648647 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-cd692370-5152-47b9-ba6d-06c80c0baac4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1812 microversion: 2.20 time: 0.277621 Feb 16 14:28:47.649204 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 235/516] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:47 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1812 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:28:47.825786 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-69a72c93-8108-46b2-9ec9-ae2d73f7ac2a req-94694e77-2906-437c-b571-07da857d4893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dcd0641-a2af-472e-afdb-1b7c1c72666f", "name": "network-vif-deleted", "tag": "47ff8a4b-9375-4563-92b3-af528e61b72f"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:28:47.828084 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:28:47.828084 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:28:47.836779 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-69a72c93-8108-46b2-9ec9-ae2d73f7ac2a req-94694e77-2906-437c-b571-07da857d4893 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:47.837210 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-69a72c93-8108-46b2-9ec9-ae2d73f7ac2a req-94694e77-2906-437c-b571-07da857d4893 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:47.850281 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-69a72c93-8108-46b2-9ec9-ae2d73f7ac2a req-94694e77-2906-437c-b571-07da857d4893 service nova] Creating event network-vif-deleted:47ff8a4b-9375-4563-92b3-af528e61b72f for instance 3dcd0641-a2af-472e-afdb-1b7c1c72666f on hv-cinder-80473 Feb 16 14:28:47.855776 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-69a72c93-8108-46b2-9ec9-ae2d73f7ac2a req-94694e77-2906-437c-b571-07da857d4893 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033756 Feb 16 14:28:47.856764 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 282/517] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:28:48.302337 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-dc3afd9b-9013-44fe-a3f4-6c270d0fa8fd tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:48.303024 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-dc3afd9b-9013-44fe-a3f4-6c270d0fa8fd tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:48.308883 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dc3afd9b-9013-44fe-a3f4-6c270d0fa8fd tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:48.309334 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dc3afd9b-9013-44fe-a3f4-6c270d0fa8fd tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:48.310118 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dc3afd9b-9013-44fe-a3f4-6c270d0fa8fd tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:48.310561 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dc3afd9b-9013-44fe-a3f4-6c270d0fa8fd tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:48.369919 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-dc3afd9b-9013-44fe-a3f4-6c270d0fa8fd tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:48.377537 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-dc3afd9b-9013-44fe-a3f4-6c270d0fa8fd tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1469 microversion: 2.1 time: 0.078845 Feb 16 14:28:48.378101 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 236/518] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:48 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1469 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:48.673093 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-76b24f9a-7a9f-4d7a-b3e1-4de3a86a05c3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:48.674440 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-76b24f9a-7a9f-4d7a-b3e1-4de3a86a05c3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:48.684707 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-76b24f9a-7a9f-4d7a-b3e1-4de3a86a05c3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:48.685214 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-76b24f9a-7a9f-4d7a-b3e1-4de3a86a05c3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:48.686154 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-76b24f9a-7a9f-4d7a-b3e1-4de3a86a05c3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:48.686695 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-76b24f9a-7a9f-4d7a-b3e1-4de3a86a05c3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:48.818484 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-76b24f9a-7a9f-4d7a-b3e1-4de3a86a05c3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:48.826617 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-76b24f9a-7a9f-4d7a-b3e1-4de3a86a05c3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:48.829257 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-76b24f9a-7a9f-4d7a-b3e1-4de3a86a05c3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:48.830387 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-76b24f9a-7a9f-4d7a-b3e1-4de3a86a05c3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1812 microversion: 2.20 time: 0.165285 Feb 16 14:28:48.830971 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 283/519] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:48 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1812 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:28:49.394478 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-bf49a097-07bf-46be-8bd3-bca194838cb3 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:49.395119 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-bf49a097-07bf-46be-8bd3-bca194838cb3 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:49.401608 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bf49a097-07bf-46be-8bd3-bca194838cb3 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:49.402058 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bf49a097-07bf-46be-8bd3-bca194838cb3 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:49.402869 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bf49a097-07bf-46be-8bd3-bca194838cb3 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:49.403313 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bf49a097-07bf-46be-8bd3-bca194838cb3 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:49.467508 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-bf49a097-07bf-46be-8bd3-bca194838cb3 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:49.475093 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-bf49a097-07bf-46be-8bd3-bca194838cb3 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1469 microversion: 2.1 time: 0.084370 Feb 16 14:28:49.475699 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 237/520] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:49 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1469 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:49.849458 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-eb1ac10a-d3fc-4bf2-b415-eb6c34a6f5f9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:49.850194 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-eb1ac10a-d3fc-4bf2-b415-eb6c34a6f5f9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:49.856644 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-eb1ac10a-d3fc-4bf2-b415-eb6c34a6f5f9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:49.857090 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-eb1ac10a-d3fc-4bf2-b415-eb6c34a6f5f9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:49.857887 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-eb1ac10a-d3fc-4bf2-b415-eb6c34a6f5f9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:49.858312 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-eb1ac10a-d3fc-4bf2-b415-eb6c34a6f5f9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:50.027127 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-eb1ac10a-d3fc-4bf2-b415-eb6c34a6f5f9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:50.045199 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-eb1ac10a-d3fc-4bf2-b415-eb6c34a6f5f9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:50.046760 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-eb1ac10a-d3fc-4bf2-b415-eb6c34a6f5f9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:50.048381 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-eb1ac10a-d3fc-4bf2-b415-eb6c34a6f5f9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1812 microversion: 2.20 time: 0.203176 Feb 16 14:28:50.049383 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 284/521] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:49 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1812 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:28:50.493238 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-0ea30ce3-6fd8-4851-a8db-52c10c05486c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:50.494810 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-0ea30ce3-6fd8-4851-a8db-52c10c05486c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:50.506453 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0ea30ce3-6fd8-4851-a8db-52c10c05486c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:50.507019 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0ea30ce3-6fd8-4851-a8db-52c10c05486c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:50.508042 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0ea30ce3-6fd8-4851-a8db-52c10c05486c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:50.508545 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0ea30ce3-6fd8-4851-a8db-52c10c05486c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:50.581604 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-0ea30ce3-6fd8-4851-a8db-52c10c05486c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:50.590286 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-0ea30ce3-6fd8-4851-a8db-52c10c05486c tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1469 microversion: 2.1 time: 0.100671 Feb 16 14:28:50.600561 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 238/522] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:50 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1469 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:50.865328 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-9d3050bd-d295-4188-b2b4-7071767eac26 req-07564530-1a55-493c-acdf-eac9d699bf25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2139817-3f2e-4e56-87d6-a56a2ca2f6f9", "name": "network-vif-plugged", "status": "completed", "tag": "e636434b-73f6-458a-9681-a71516b2260d"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:28:50.870221 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:28:50.870221 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:28:50.879782 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-9d3050bd-d295-4188-b2b4-7071767eac26 req-07564530-1a55-493c-acdf-eac9d699bf25 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:50.880224 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-9d3050bd-d295-4188-b2b4-7071767eac26 req-07564530-1a55-493c-acdf-eac9d699bf25 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:50.892394 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-9d3050bd-d295-4188-b2b4-7071767eac26 req-07564530-1a55-493c-acdf-eac9d699bf25 service nova] Creating event network-vif-plugged:e636434b-73f6-458a-9681-a71516b2260d for instance e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 on hv-cinder-80473 Feb 16 14:28:50.897221 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-9d3050bd-d295-4188-b2b4-7071767eac26 req-07564530-1a55-493c-acdf-eac9d699bf25 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035664 Feb 16 14:28:50.897816 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 285/523] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:28:51.066745 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b0b9531e-a606-4ee7-ad85-c568d70af803 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:51.067412 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b0b9531e-a606-4ee7-ad85-c568d70af803 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:51.073515 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b0b9531e-a606-4ee7-ad85-c568d70af803 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:51.073974 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b0b9531e-a606-4ee7-ad85-c568d70af803 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:51.075934 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b0b9531e-a606-4ee7-ad85-c568d70af803 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:51.075934 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b0b9531e-a606-4ee7-ad85-c568d70af803 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:51.218788 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b0b9531e-a606-4ee7-ad85-c568d70af803 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:51.227023 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b0b9531e-a606-4ee7-ad85-c568d70af803 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:51.228531 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b0b9531e-a606-4ee7-ad85-c568d70af803 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:51.229707 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b0b9531e-a606-4ee7-ad85-c568d70af803 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1812 microversion: 2.20 time: 0.167713 Feb 16 14:28:51.230402 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 239/524] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:51 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1812 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:28:51.608170 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-5d8a6be9-2b0a-4642-ae16-55fab0931bd6 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:51.609666 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-5d8a6be9-2b0a-4642-ae16-55fab0931bd6 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:51.615934 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5d8a6be9-2b0a-4642-ae16-55fab0931bd6 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:51.617882 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5d8a6be9-2b0a-4642-ae16-55fab0931bd6 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:51.617882 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5d8a6be9-2b0a-4642-ae16-55fab0931bd6 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:51.617882 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5d8a6be9-2b0a-4642-ae16-55fab0931bd6 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:51.651249 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5d8a6be9-2b0a-4642-ae16-55fab0931bd6 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:51.651774 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5d8a6be9-2b0a-4642-ae16-55fab0931bd6 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:51.652260 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.objects.instance [None req-5d8a6be9-2b0a-4642-ae16-55fab0931bd6 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lazy-loading 'fault' on Instance uuid 3dcd0641-a2af-472e-afdb-1b7c1c72666f {{(pid=117031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:28:51.698020 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-5d8a6be9-2b0a-4642-ae16-55fab0931bd6 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:51.707234 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-5d8a6be9-2b0a-4642-ae16-55fab0931bd6 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 200 len: 1315 microversion: 2.1 time: 0.103635 Feb 16 14:28:51.708106 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 286/525] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:51 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 1315 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:52.247647 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-8b15f3f1-d5ea-4eca-85e7-e7bfeee18e45 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:52.249999 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-8b15f3f1-d5ea-4eca-85e7-e7bfeee18e45 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:52.256527 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8b15f3f1-d5ea-4eca-85e7-e7bfeee18e45 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:52.256988 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8b15f3f1-d5ea-4eca-85e7-e7bfeee18e45 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:52.257782 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8b15f3f1-d5ea-4eca-85e7-e7bfeee18e45 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:52.258405 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8b15f3f1-d5ea-4eca-85e7-e7bfeee18e45 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:52.415624 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-8b15f3f1-d5ea-4eca-85e7-e7bfeee18e45 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:52.416205 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-8b15f3f1-d5ea-4eca-85e7-e7bfeee18e45 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:52.417694 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-8b15f3f1-d5ea-4eca-85e7-e7bfeee18e45 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:52.418921 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-8b15f3f1-d5ea-4eca-85e7-e7bfeee18e45 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1812 microversion: 2.20 time: 0.174939 Feb 16 14:28:52.419460 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 240/526] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:52 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1812 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:28:52.724951 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-2ed26c08-ceb9-4148-95df-e756e65fb77e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:52.725508 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-2ed26c08-ceb9-4148-95df-e756e65fb77e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 3dcd0641-a2af-472e-afdb-1b7c1c72666f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:52.731329 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-2ed26c08-ceb9-4148-95df-e756e65fb77e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:52.731771 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-2ed26c08-ceb9-4148-95df-e756e65fb77e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:52.732584 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-2ed26c08-ceb9-4148-95df-e756e65fb77e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:52.733025 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-2ed26c08-ceb9-4148-95df-e756e65fb77e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:52.747346 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.wsgi [None req-2ed26c08-ceb9-4148-95df-e756e65fb77e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] HTTP exception thrown: Instance 3dcd0641-a2af-472e-afdb-1b7c1c72666f could not be found. Feb 16 14:28:52.747970 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-2ed26c08-ceb9-4148-95df-e756e65fb77e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Returning 404 to user: Instance 3dcd0641-a2af-472e-afdb-1b7c1c72666f could not be found. {{(pid=117031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:28:52.748795 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-2ed26c08-ceb9-4148-95df-e756e65fb77e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f" status: 404 len: 111 microversion: 2.1 time: 0.027678 Feb 16 14:28:52.749558 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 287/527] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:52 2022] GET /compute/v2.1/servers/3dcd0641-a2af-472e-afdb-1b7c1c72666f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 16 14:28:52.757304 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-4a350f3c-53f3-49b8-b518-3c02306c259f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:52.757796 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-4a350f3c-53f3-49b8-b518-3c02306c259f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:52.763689 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4a350f3c-53f3-49b8-b518-3c02306c259f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:52.764170 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4a350f3c-53f3-49b8-b518-3c02306c259f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:52.764990 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4a350f3c-53f3-49b8-b518-3c02306c259f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:52.765442 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4a350f3c-53f3-49b8-b518-3c02306c259f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:52.790676 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-4a350f3c-53f3-49b8-b518-3c02306c259f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Going to try to terminate instance {{(pid=117032) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 16 14:28:53.141820 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-4a350f3c-53f3-49b8-b518-3c02306c259f tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "DELETE /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 204 len: 0 microversion: 2.1 time: 0.387784 Feb 16 14:28:53.142494 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 241/528] 10.222.0.110 () {58 vars in 1243 bytes} [Wed Feb 16 14:28:52 2022] DELETE /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 16 14:28:53.150291 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-a5336f8a-0064-4ad8-9e93-3cbaf6675b3e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:53.150923 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-a5336f8a-0064-4ad8-9e93-3cbaf6675b3e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:53.159718 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a5336f8a-0064-4ad8-9e93-3cbaf6675b3e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:53.160450 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a5336f8a-0064-4ad8-9e93-3cbaf6675b3e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:53.161712 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a5336f8a-0064-4ad8-9e93-3cbaf6675b3e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:53.162251 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a5336f8a-0064-4ad8-9e93-3cbaf6675b3e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:53.308644 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-a5336f8a-0064-4ad8-9e93-3cbaf6675b3e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:53.317435 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-a5336f8a-0064-4ad8-9e93-3cbaf6675b3e tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1525 microversion: 2.1 time: 0.170778 Feb 16 14:28:53.317996 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 288/529] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:53 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1525 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:53.451976 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-1f22be48-e130-4db2-89f1-0fd585be965e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:53.453682 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-1f22be48-e130-4db2-89f1-0fd585be965e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:53.460770 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1f22be48-e130-4db2-89f1-0fd585be965e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:53.461253 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1f22be48-e130-4db2-89f1-0fd585be965e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:53.461991 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1f22be48-e130-4db2-89f1-0fd585be965e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:53.462430 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1f22be48-e130-4db2-89f1-0fd585be965e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:53.605175 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-1f22be48-e130-4db2-89f1-0fd585be965e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:53.626667 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-1f22be48-e130-4db2-89f1-0fd585be965e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:53.629843 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-1f22be48-e130-4db2-89f1-0fd585be965e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:53.630136 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-1f22be48-e130-4db2-89f1-0fd585be965e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1812 microversion: 2.20 time: 0.195998 Feb 16 14:28:53.631238 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 242/530] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:53 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1812 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:28:54.337753 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-b9adac70-2bb5-417e-b5c8-6936e4a17fab tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:54.338828 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-b9adac70-2bb5-417e-b5c8-6936e4a17fab tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:54.348198 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b9adac70-2bb5-417e-b5c8-6936e4a17fab tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:54.348866 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b9adac70-2bb5-417e-b5c8-6936e4a17fab tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:54.350083 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b9adac70-2bb5-417e-b5c8-6936e4a17fab tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:54.350812 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b9adac70-2bb5-417e-b5c8-6936e4a17fab tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:54.497138 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-b9adac70-2bb5-417e-b5c8-6936e4a17fab tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:54.505127 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-b9adac70-2bb5-417e-b5c8-6936e4a17fab tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1525 microversion: 2.1 time: 0.173407 Feb 16 14:28:54.505919 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 289/531] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:54 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1525 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:54.649758 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-2be52ca9-2857-4a1c-a896-66ea6c935561 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:54.650349 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-2be52ca9-2857-4a1c-a896-66ea6c935561 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:54.658721 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2be52ca9-2857-4a1c-a896-66ea6c935561 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:54.659412 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2be52ca9-2857-4a1c-a896-66ea6c935561 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:54.660209 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2be52ca9-2857-4a1c-a896-66ea6c935561 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:54.664329 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2be52ca9-2857-4a1c-a896-66ea6c935561 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:54.824927 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-2be52ca9-2857-4a1c-a896-66ea6c935561 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:54.832236 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-2be52ca9-2857-4a1c-a896-66ea6c935561 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:54.833779 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-2be52ca9-2857-4a1c-a896-66ea6c935561 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:54.834998 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-2be52ca9-2857-4a1c-a896-66ea6c935561 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1812 microversion: 2.20 time: 0.189605 Feb 16 14:28:54.835561 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 243/532] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:54 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1812 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:28:55.522316 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-55e76f27-a6b7-42f2-b729-2ae86d2e6213 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:55.522940 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-55e76f27-a6b7-42f2-b729-2ae86d2e6213 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:55.528794 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-55e76f27-a6b7-42f2-b729-2ae86d2e6213 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:55.529234 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-55e76f27-a6b7-42f2-b729-2ae86d2e6213 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:55.529999 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-55e76f27-a6b7-42f2-b729-2ae86d2e6213 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:55.530426 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-55e76f27-a6b7-42f2-b729-2ae86d2e6213 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:55.663116 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-55e76f27-a6b7-42f2-b729-2ae86d2e6213 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:55.672603 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-55e76f27-a6b7-42f2-b729-2ae86d2e6213 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1525 microversion: 2.1 time: 0.153180 Feb 16 14:28:55.673385 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 290/533] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:55 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1525 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:55.853101 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6f1c08d3-c3f1-4ad9-a522-fec2e24d67eb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:55.853713 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-6f1c08d3-c3f1-4ad9-a522-fec2e24d67eb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:55.860270 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6f1c08d3-c3f1-4ad9-a522-fec2e24d67eb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:55.860788 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6f1c08d3-c3f1-4ad9-a522-fec2e24d67eb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:55.861577 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6f1c08d3-c3f1-4ad9-a522-fec2e24d67eb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:55.862019 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6f1c08d3-c3f1-4ad9-a522-fec2e24d67eb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:56.005538 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6f1c08d3-c3f1-4ad9-a522-fec2e24d67eb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:56.014007 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6f1c08d3-c3f1-4ad9-a522-fec2e24d67eb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:56.015566 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6f1c08d3-c3f1-4ad9-a522-fec2e24d67eb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:56.017187 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-6f1c08d3-c3f1-4ad9-a522-fec2e24d67eb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1812 microversion: 2.20 time: 0.167904 Feb 16 14:28:56.017750 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 244/534] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:55 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1812 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:28:56.689748 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-7fc904a4-0d64-49d1-a6e3-16ca545c5c8b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:56.690455 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-7fc904a4-0d64-49d1-a6e3-16ca545c5c8b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:56.698018 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7fc904a4-0d64-49d1-a6e3-16ca545c5c8b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:56.698584 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7fc904a4-0d64-49d1-a6e3-16ca545c5c8b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:56.699497 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7fc904a4-0d64-49d1-a6e3-16ca545c5c8b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:56.700020 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7fc904a4-0d64-49d1-a6e3-16ca545c5c8b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:56.841332 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-7fc904a4-0d64-49d1-a6e3-16ca545c5c8b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:56.849158 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-7fc904a4-0d64-49d1-a6e3-16ca545c5c8b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1525 microversion: 2.1 time: 0.163313 Feb 16 14:28:56.849717 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 291/535] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:56 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1525 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:57.039698 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-459eedaf-7f2f-4547-b868-876c17a18b09 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:57.040817 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-459eedaf-7f2f-4547-b868-876c17a18b09 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:57.047677 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-459eedaf-7f2f-4547-b868-876c17a18b09 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:57.049945 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-459eedaf-7f2f-4547-b868-876c17a18b09 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:57.049945 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-459eedaf-7f2f-4547-b868-876c17a18b09 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:57.049945 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-459eedaf-7f2f-4547-b868-876c17a18b09 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:57.192545 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-459eedaf-7f2f-4547-b868-876c17a18b09 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:57.203004 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-459eedaf-7f2f-4547-b868-876c17a18b09 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:57.205923 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-459eedaf-7f2f-4547-b868-876c17a18b09 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:57.207599 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-459eedaf-7f2f-4547-b868-876c17a18b09 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1812 microversion: 2.20 time: 0.171603 Feb 16 14:28:57.208160 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 245/536] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:57 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1812 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:28:57.866316 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-09166a11-00ec-418b-9402-4c90b804f35b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:57.866908 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-09166a11-00ec-418b-9402-4c90b804f35b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:57.872986 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-09166a11-00ec-418b-9402-4c90b804f35b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:57.873441 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-09166a11-00ec-418b-9402-4c90b804f35b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:57.874221 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-09166a11-00ec-418b-9402-4c90b804f35b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:57.874682 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-09166a11-00ec-418b-9402-4c90b804f35b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:58.006638 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-09166a11-00ec-418b-9402-4c90b804f35b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:58.013806 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-09166a11-00ec-418b-9402-4c90b804f35b tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1525 microversion: 2.1 time: 0.151229 Feb 16 14:28:58.014368 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 292/537] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:57 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1525 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:58.225661 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-74888c20-be9a-4fa9-af81-6d2169ff9a3b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:58.226176 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-74888c20-be9a-4fa9-af81-6d2169ff9a3b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:58.232457 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-74888c20-be9a-4fa9-af81-6d2169ff9a3b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:58.232923 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-74888c20-be9a-4fa9-af81-6d2169ff9a3b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:58.233688 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-74888c20-be9a-4fa9-af81-6d2169ff9a3b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:58.234119 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-74888c20-be9a-4fa9-af81-6d2169ff9a3b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:58.371456 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-74888c20-be9a-4fa9-af81-6d2169ff9a3b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:58.381835 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-74888c20-be9a-4fa9-af81-6d2169ff9a3b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:58.383601 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-74888c20-be9a-4fa9-af81-6d2169ff9a3b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:58.384765 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-74888c20-be9a-4fa9-af81-6d2169ff9a3b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1812 microversion: 2.20 time: 0.162944 Feb 16 14:28:58.391380 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 246/538] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:58 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1812 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:28:59.031513 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-bc461731-471e-4a3d-968b-57c661669354 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:59.032152 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-bc461731-471e-4a3d-968b-57c661669354 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:59.039402 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-bc461731-471e-4a3d-968b-57c661669354 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:59.039850 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-bc461731-471e-4a3d-968b-57c661669354 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:59.040926 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-bc461731-471e-4a3d-968b-57c661669354 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:59.041444 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-bc461731-471e-4a3d-968b-57c661669354 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:59.126580 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-529e999f-db10-4f50-a17c-94120fd0ca92 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-513846100", "imageRef": "2493d2dc-e081-43d3-8292-91b4762a21e8", "flavorRef": "452", "networks": [{"uuid": "020f3991-eae7-469b-87bf-c0a4566703d8"}]}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:28:59.218862 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-bc461731-471e-4a3d-968b-57c661669354 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b7c9898884449ca201f16f583baa21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4ddcdf7f0a469fa577164b86beb7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:59.228031 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-bc461731-471e-4a3d-968b-57c661669354 tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 200 len: 1525 microversion: 2.1 time: 0.200382 Feb 16 14:28:59.233775 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 293/539] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:28:59 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 1525 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:28:59.405125 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-8ddab3e3-83e7-4d5f-931d-724d554830fa tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:28:59.406544 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-8ddab3e3-83e7-4d5f-931d-724d554830fa tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:28:59.413526 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8ddab3e3-83e7-4d5f-931d-724d554830fa tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:59.414060 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8ddab3e3-83e7-4d5f-931d-724d554830fa tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:59.414998 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8ddab3e3-83e7-4d5f-931d-724d554830fa tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:28:59.415490 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8ddab3e3-83e7-4d5f-931d-724d554830fa tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:28:59.560417 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-8ddab3e3-83e7-4d5f-931d-724d554830fa tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:59.570340 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-8ddab3e3-83e7-4d5f-931d-724d554830fa tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:59.572012 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-8ddab3e3-83e7-4d5f-931d-724d554830fa tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:28:59.573271 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-8ddab3e3-83e7-4d5f-931d-724d554830fa tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1812 microversion: 2.20 time: 0.172707 Feb 16 14:28:59.573764 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 294/540] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:28:59 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1812 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:28:59.598120 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-83402176-3fb6-47af-8072-49d37516faf7 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-672652320", "imageRef": "2493d2dc-e081-43d3-8292-91b4762a21e8", "flavorRef": "452"}} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:29:07.947915 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.network.neutron [None req-529e999f-db10-4f50-a17c-94120fd0ca92 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] validate_networks() for [('020f3991-eae7-469b-87bf-c0a4566703d8', None, None, None, None, None)] {{(pid=117032) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 16 14:29:07.964121 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.network.neutron [None req-83402176-3fb6-47af-8072-49d37516faf7 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] validate_networks() for None {{(pid=117031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 16 14:29:08.291180 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-83402176-3fb6-47af-8072-49d37516faf7 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Flavor limits 0:0:0 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 16 14:29:08.292192 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-83402176-3fb6-47af-8072-49d37516faf7 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Image limits 0:0:0 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 16 14:29:08.293200 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-83402176-3fb6-47af-8072-49d37516faf7 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Flavor pref 0:0:0 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 16 14:29:08.294081 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-83402176-3fb6-47af-8072-49d37516faf7 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Image pref 0:0:0 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 16 14:29:08.294556 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-83402176-3fb6-47af-8072-49d37516faf7 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 16 14:29:08.304847 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-83402176-3fb6-47af-8072-49d37516faf7 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:08.306182 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-83402176-3fb6-47af-8072-49d37516faf7 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:08.307384 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-83402176-3fb6-47af-8072-49d37516faf7 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:08.308236 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-83402176-3fb6-47af-8072-49d37516faf7 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:08.326368 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.quota [None req-83402176-3fb6-47af-8072-49d37516faf7 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Getting quotas for project 3600c4b4e2bf461f8716f080c94c58a3. Resources: {'cores', 'instances', 'ram'} {{(pid=117031) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 14:29:08.331117 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.quota [None req-83402176-3fb6-47af-8072-49d37516faf7 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Getting quotas for user 3770e2e31549417ea8b0f9055a128bd2 and project 3600c4b4e2bf461f8716f080c94c58a3. Resources: {'cores', 'instances', 'ram'} {{(pid=117031) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 14:29:08.342747 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-83402176-3fb6-47af-8072-49d37516faf7 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Going to run 1 instances... {{(pid=117031) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 16 14:29:08.347489 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-83402176-3fb6-47af-8072-49d37516faf7 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] [instance: 9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2493d2dc-e081-43d3-8292-91b4762a21e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 16 14:29:08.349430 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-529e999f-db10-4f50-a17c-94120fd0ca92 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Flavor limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 16 14:29:08.349866 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-529e999f-db10-4f50-a17c-94120fd0ca92 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Image limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 16 14:29:08.350861 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-529e999f-db10-4f50-a17c-94120fd0ca92 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Flavor pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 16 14:29:08.351560 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-529e999f-db10-4f50-a17c-94120fd0ca92 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Image pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 16 14:29:08.352920 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-529e999f-db10-4f50-a17c-94120fd0ca92 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 16 14:29:08.371061 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-529e999f-db10-4f50-a17c-94120fd0ca92 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:08.371509 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-529e999f-db10-4f50-a17c-94120fd0ca92 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:08.375475 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-529e999f-db10-4f50-a17c-94120fd0ca92 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:08.376349 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-529e999f-db10-4f50-a17c-94120fd0ca92 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:08.395176 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-529e999f-db10-4f50-a17c-94120fd0ca92 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Getting quotas for project f6c24eb6d16648b4a04462f208612157. Resources: {'cores', 'instances', 'ram'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 14:29:08.400173 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-529e999f-db10-4f50-a17c-94120fd0ca92 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Getting quotas for user 607d12050d20401e9850ab64c57b8c04 and project f6c24eb6d16648b4a04462f208612157. Resources: {'cores', 'instances', 'ram'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 14:29:08.411395 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-529e999f-db10-4f50-a17c-94120fd0ca92 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Going to run 1 instances... {{(pid=117032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 16 14:29:08.414917 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-529e999f-db10-4f50-a17c-94120fd0ca92 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: 7a7441d1-fed1-484d-8802-a1ef5e016198] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2493d2dc-e081-43d3-8292-91b4762a21e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 16 14:29:08.484903 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-83402176-3fb6-47af-8072-49d37516faf7 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] 10.222.0.110 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 8.890471 Feb 16 14:29:08.487170 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 295/541] 10.222.0.110 () {60 vars in 1151 bytes} [Wed Feb 16 14:28:59 2022] POST /compute/v2.1/servers => generated 382 bytes in 8893 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Feb 16 14:29:08.492139 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-5b48acdf-d909-46b9-b05e-5110afd66e2d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:08.493011 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-5b48acdf-d909-46b9-b05e-5110afd66e2d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] [instance: 05accb7b-6275-4c8e-a18b-69b67bdc1d8d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:08.503707 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5b48acdf-d909-46b9-b05e-5110afd66e2d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:08.504137 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5b48acdf-d909-46b9-b05e-5110afd66e2d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:08.504915 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5b48acdf-d909-46b9-b05e-5110afd66e2d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:08.505344 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5b48acdf-d909-46b9-b05e-5110afd66e2d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:08.524292 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.wsgi [None req-5b48acdf-d909-46b9-b05e-5110afd66e2d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] HTTP exception thrown: Instance 05accb7b-6275-4c8e-a18b-69b67bdc1d8d could not be found. Feb 16 14:29:08.526362 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-5b48acdf-d909-46b9-b05e-5110afd66e2d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] Returning 404 to user: Instance 05accb7b-6275-4c8e-a18b-69b67bdc1d8d could not be found. {{(pid=117031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:29:08.527241 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-5b48acdf-d909-46b9-b05e-5110afd66e2d tempest-ServerRescueNegativeTestJSON-376192323 tempest-ServerRescueNegativeTestJSON-376192323-project] 10.222.0.110 "GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d" status: 404 len: 111 microversion: 2.1 time: 0.038788 Feb 16 14:29:08.527795 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 296/542] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:08 2022] GET /compute/v2.1/servers/05accb7b-6275-4c8e-a18b-69b67bdc1d8d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 14:29:08.532304 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-01b2312e-07f2-4ae2-93d0-fc67fc9452b7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:08.533180 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-01b2312e-07f2-4ae2-93d0-fc67fc9452b7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:08.541066 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-01b2312e-07f2-4ae2-93d0-fc67fc9452b7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:08.544745 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-01b2312e-07f2-4ae2-93d0-fc67fc9452b7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:08.544745 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-01b2312e-07f2-4ae2-93d0-fc67fc9452b7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:08.544745 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-01b2312e-07f2-4ae2-93d0-fc67fc9452b7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:08.551948 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-529e999f-db10-4f50-a17c-94120fd0ca92 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 9.429933 Feb 16 14:29:08.552697 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 247/543] 10.222.0.110 () {60 vars in 1151 bytes} [Wed Feb 16 14:28:59 2022] POST /compute/v2.1/servers => generated 382 bytes in 9432 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Feb 16 14:29:08.557509 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-da64a2e3-25df-447b-a766-c2de823fea5d req-786b3e7f-97c6-4e6e-973d-09b759f73c5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05accb7b-6275-4c8e-a18b-69b67bdc1d8d", "name": "network-vif-deleted", "tag": "9be133d6-37da-4b5d-bf19-f8153906954d"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:29:08.559615 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:29:08.559615 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: warnings.warn(msg) Feb 16 14:29:08.602248 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-da64a2e3-25df-447b-a766-c2de823fea5d req-786b3e7f-97c6-4e6e-973d-09b759f73c5e service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:08.605305 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-da64a2e3-25df-447b-a766-c2de823fea5d req-786b3e7f-97c6-4e6e-973d-09b759f73c5e service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:08.633051 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-da64a2e3-25df-447b-a766-c2de823fea5d req-786b3e7f-97c6-4e6e-973d-09b759f73c5e service nova] Creating event network-vif-deleted:9be133d6-37da-4b5d-bf19-f8153906954d for instance 05accb7b-6275-4c8e-a18b-69b67bdc1d8d on hv-cinder-80473 Feb 16 14:29:08.651596 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-da64a2e3-25df-447b-a766-c2de823fea5d req-786b3e7f-97c6-4e6e-973d-09b759f73c5e service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090616 Feb 16 14:29:08.651596 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 248/544] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:29:08.684015 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-04d71c2f-824c-4139-93e4-4ed789bff9fe tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:08.688111 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-04d71c2f-824c-4139-93e4-4ed789bff9fe tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] [instance: 9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:08.811195 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-04d71c2f-824c-4139-93e4-4ed789bff9fe tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3770e2e31549417ea8b0f9055a128bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600c4b4e2bf461f8716f080c94c58a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:08.820846 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-04d71c2f-824c-4139-93e4-4ed789bff9fe tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] 10.222.0.110 "GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066" status: 200 len: 1218 microversion: 2.1 time: 0.169080 Feb 16 14:29:08.831350 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 249/545] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:08 2022] GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066 => generated 1218 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:08.837464 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f3146473-1868-4399-bc9b-0e1c57f64f95 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:08.838094 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f3146473-1868-4399-bc9b-0e1c57f64f95 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: 7a7441d1-fed1-484d-8802-a1ef5e016198] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:08.906131 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f3146473-1868-4399-bc9b-0e1c57f64f95 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:08.914014 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f3146473-1868-4399-bc9b-0e1c57f64f95 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198" status: 200 len: 1222 microversion: 2.1 time: 0.081275 Feb 16 14:29:08.915341 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 250/546] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:08 2022] GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:09.172619 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-01b2312e-07f2-4ae2-93d0-fc67fc9452b7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:09.184217 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-01b2312e-07f2-4ae2-93d0-fc67fc9452b7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:09.186217 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-01b2312e-07f2-4ae2-93d0-fc67fc9452b7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:09.187886 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-01b2312e-07f2-4ae2-93d0-fc67fc9452b7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1799 microversion: 2.20 time: 0.659002 Feb 16 14:29:09.188623 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 297/547] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:29:08 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1799 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:29:09.838235 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-29ad163a-3f48-44f3-98f8-57376685235a tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:09.838804 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-29ad163a-3f48-44f3-98f8-57376685235a tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] [instance: 9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:09.901198 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-1cc38d1b-c46d-4569-8ea1-9491d20defd9 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:09.902024 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-1cc38d1b-c46d-4569-8ea1-9491d20defd9 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:09.908874 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1cc38d1b-c46d-4569-8ea1-9491d20defd9 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:09.909674 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1cc38d1b-c46d-4569-8ea1-9491d20defd9 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:09.910704 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1cc38d1b-c46d-4569-8ea1-9491d20defd9 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:09.911359 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1cc38d1b-c46d-4569-8ea1-9491d20defd9 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:09.958756 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-29ad163a-3f48-44f3-98f8-57376685235a tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3770e2e31549417ea8b0f9055a128bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600c4b4e2bf461f8716f080c94c58a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:09.977181 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-29ad163a-3f48-44f3-98f8-57376685235a tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] 10.222.0.110 "GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066" status: 200 len: 1218 microversion: 2.1 time: 0.142943 Feb 16 14:29:10.009415 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 251/548] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:09 2022] GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066 => generated 1218 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:10.014565 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-cb49f78e-00d4-4848-aad7-f546a965701e tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:10.023224 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-cb49f78e-00d4-4848-aad7-f546a965701e tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: 7a7441d1-fed1-484d-8802-a1ef5e016198] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:10.046013 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cb49f78e-00d4-4848-aad7-f546a965701e tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:10.046538 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cb49f78e-00d4-4848-aad7-f546a965701e tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:10.052798 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cb49f78e-00d4-4848-aad7-f546a965701e tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:10.054010 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cb49f78e-00d4-4848-aad7-f546a965701e tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:10.077731 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.objects.instance [None req-1cc38d1b-c46d-4569-8ea1-9491d20defd9 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lazy-loading 'services' on Instance uuid 64a4628d-ace6-4282-948c-d3e154ba9f35 {{(pid=117031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:29:10.185952 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-cb49f78e-00d4-4848-aad7-f546a965701e tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:10.206979 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-cb49f78e-00d4-4848-aad7-f546a965701e tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198" status: 200 len: 1226 microversion: 2.1 time: 0.195668 Feb 16 14:29:10.211189 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 252/549] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:10 2022] GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198 => generated 1226 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:10.492708 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-1cc38d1b-c46d-4569-8ea1-9491d20defd9 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "DELETE /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35/os-volume_attachments/3a9391a2-82da-482d-ac1f-0887b643668a" status: 202 len: 0 microversion: 2.1 time: 0.593598 Feb 16 14:29:10.504743 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 298/550] 10.222.0.110 () {58 vars in 1420 bytes} [Wed Feb 16 14:29:09 2022] DELETE /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35/os-volume_attachments/3a9391a2-82da-482d-ac1f-0887b643668a => generated 0 bytes in 598 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 16 14:29:10.996159 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-35de0396-10ce-41a3-b1ac-6f9411eb5010 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:10.996850 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-35de0396-10ce-41a3-b1ac-6f9411eb5010 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] [instance: 9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:11.004621 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-35de0396-10ce-41a3-b1ac-6f9411eb5010 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:11.005781 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-35de0396-10ce-41a3-b1ac-6f9411eb5010 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:11.008708 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-35de0396-10ce-41a3-b1ac-6f9411eb5010 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:11.010121 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-35de0396-10ce-41a3-b1ac-6f9411eb5010 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:11.127344 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-35de0396-10ce-41a3-b1ac-6f9411eb5010 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3770e2e31549417ea8b0f9055a128bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600c4b4e2bf461f8716f080c94c58a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:11.136378 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-35de0396-10ce-41a3-b1ac-6f9411eb5010 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] 10.222.0.110 "GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066" status: 200 len: 1270 microversion: 2.1 time: 0.144176 Feb 16 14:29:11.139422 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 253/551] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:10 2022] GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066 => generated 1270 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:11.233535 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-76ddae89-4fac-43bc-87d5-fa41c718be09 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:11.235404 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-76ddae89-4fac-43bc-87d5-fa41c718be09 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: 7a7441d1-fed1-484d-8802-a1ef5e016198] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:11.242997 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-76ddae89-4fac-43bc-87d5-fa41c718be09 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:11.243557 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-76ddae89-4fac-43bc-87d5-fa41c718be09 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:11.244609 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-76ddae89-4fac-43bc-87d5-fa41c718be09 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:11.245303 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-76ddae89-4fac-43bc-87d5-fa41c718be09 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:11.321759 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-76ddae89-4fac-43bc-87d5-fa41c718be09 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:11.329541 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-76ddae89-4fac-43bc-87d5-fa41c718be09 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198" status: 200 len: 1274 microversion: 2.1 time: 0.100114 Feb 16 14:29:11.339717 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 299/552] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:11 2022] GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198 => generated 1274 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:12.154553 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-bae2b964-0cbe-4905-87ec-78ab0b3b51f1 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:12.155233 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-bae2b964-0cbe-4905-87ec-78ab0b3b51f1 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] [instance: 9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:12.168766 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bae2b964-0cbe-4905-87ec-78ab0b3b51f1 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:12.168766 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bae2b964-0cbe-4905-87ec-78ab0b3b51f1 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:12.168766 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bae2b964-0cbe-4905-87ec-78ab0b3b51f1 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:12.168766 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bae2b964-0cbe-4905-87ec-78ab0b3b51f1 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:12.308183 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-bae2b964-0cbe-4905-87ec-78ab0b3b51f1 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3770e2e31549417ea8b0f9055a128bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600c4b4e2bf461f8716f080c94c58a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:12.316357 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-bae2b964-0cbe-4905-87ec-78ab0b3b51f1 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] 10.222.0.110 "GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066" status: 200 len: 1278 microversion: 2.1 time: 0.166138 Feb 16 14:29:12.322675 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 254/553] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:12 2022] GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066 => generated 1278 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:12.347096 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-a8cf4c6d-1022-4e70-9a3d-39ce3d56bed7 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:12.348328 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-a8cf4c6d-1022-4e70-9a3d-39ce3d56bed7 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: 7a7441d1-fed1-484d-8802-a1ef5e016198] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:12.357263 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a8cf4c6d-1022-4e70-9a3d-39ce3d56bed7 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:12.357717 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a8cf4c6d-1022-4e70-9a3d-39ce3d56bed7 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:12.358689 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a8cf4c6d-1022-4e70-9a3d-39ce3d56bed7 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:12.359024 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a8cf4c6d-1022-4e70-9a3d-39ce3d56bed7 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:12.437026 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-a8cf4c6d-1022-4e70-9a3d-39ce3d56bed7 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:12.446328 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-a8cf4c6d-1022-4e70-9a3d-39ce3d56bed7 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198" status: 200 len: 1280 microversion: 2.1 time: 0.102967 Feb 16 14:29:12.450779 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 300/554] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:12 2022] GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198 => generated 1280 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:12.755389 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ecd51def-9f58-4f87-a367-790caada3ef6 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:29:12.764528 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ecd51def-9f58-4f87-a367-790caada3ef6 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:12.768077 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ecd51def-9f58-4f87-a367-790caada3ef6 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:12.873087 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ecd51def-9f58-4f87-a367-790caada3ef6 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Going to try to stop instance {{(pid=117032) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Feb 16 14:29:13.142954 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ecd51def-9f58-4f87-a367-790caada3ef6 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "POST /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35/action" status: 202 len: 0 microversion: 2.1 time: 0.391716 Feb 16 14:29:13.146572 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 255/555] 10.222.0.110 () {60 vars in 1282 bytes} [Wed Feb 16 14:29:12 2022] POST /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35/action => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 14:29:13.152334 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-5338a4eb-6eb3-4b77-9f43-e29b500b4e29 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:13.153206 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-5338a4eb-6eb3-4b77-9f43-e29b500b4e29 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:13.169848 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5338a4eb-6eb3-4b77-9f43-e29b500b4e29 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:13.169848 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5338a4eb-6eb3-4b77-9f43-e29b500b4e29 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:13.169848 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5338a4eb-6eb3-4b77-9f43-e29b500b4e29 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:13.169848 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5338a4eb-6eb3-4b77-9f43-e29b500b4e29 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:13.336138 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-38472e28-e88c-44e1-b2b4-d803db1e2eda tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:13.337654 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-38472e28-e88c-44e1-b2b4-d803db1e2eda tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] [instance: 9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:13.353407 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-38472e28-e88c-44e1-b2b4-d803db1e2eda tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:13.354158 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-38472e28-e88c-44e1-b2b4-d803db1e2eda tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:13.355256 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-38472e28-e88c-44e1-b2b4-d803db1e2eda tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:13.358282 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-38472e28-e88c-44e1-b2b4-d803db1e2eda tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:13.523174 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-38472e28-e88c-44e1-b2b4-d803db1e2eda tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3770e2e31549417ea8b0f9055a128bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600c4b4e2bf461f8716f080c94c58a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:13.535995 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-38472e28-e88c-44e1-b2b4-d803db1e2eda tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] 10.222.0.110 "GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066" status: 200 len: 1276 microversion: 2.1 time: 0.205985 Feb 16 14:29:13.546745 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 256/556] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:13 2022] GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066 => generated 1276 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:13.558804 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6016cddb-8469-4770-8606-ea05300ad75b tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:13.559795 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-6016cddb-8469-4770-8606-ea05300ad75b tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: 7a7441d1-fed1-484d-8802-a1ef5e016198] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:13.571397 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6016cddb-8469-4770-8606-ea05300ad75b tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:13.572157 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6016cddb-8469-4770-8606-ea05300ad75b tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:13.573620 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6016cddb-8469-4770-8606-ea05300ad75b tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:13.575633 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6016cddb-8469-4770-8606-ea05300ad75b tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:13.602174 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-5338a4eb-6eb3-4b77-9f43-e29b500b4e29 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:13.621464 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-5338a4eb-6eb3-4b77-9f43-e29b500b4e29 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1679 microversion: 2.1 time: 0.467881 Feb 16 14:29:13.622876 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 301/557] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:13 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1679 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:29:14.215701 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6016cddb-8469-4770-8606-ea05300ad75b tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:14.231345 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-6016cddb-8469-4770-8606-ea05300ad75b tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198" status: 200 len: 1322 microversion: 2.1 time: 0.683142 Feb 16 14:29:14.237242 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 257/558] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:13 2022] GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198 => generated 1322 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:14.553145 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-d39b118c-6795-4590-b83f-653183e06c7c tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:14.553815 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-d39b118c-6795-4590-b83f-653183e06c7c tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] [instance: 9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:14.572589 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d39b118c-6795-4590-b83f-653183e06c7c tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:14.573047 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d39b118c-6795-4590-b83f-653183e06c7c tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:14.574216 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d39b118c-6795-4590-b83f-653183e06c7c tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:14.574860 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d39b118c-6795-4590-b83f-653183e06c7c tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:14.639127 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f46ba7df-8fc0-4543-90bb-797fc21bb944 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:14.640834 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f46ba7df-8fc0-4543-90bb-797fc21bb944 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:14.655710 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f46ba7df-8fc0-4543-90bb-797fc21bb944 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:14.656604 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f46ba7df-8fc0-4543-90bb-797fc21bb944 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:14.657364 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f46ba7df-8fc0-4543-90bb-797fc21bb944 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:14.657812 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f46ba7df-8fc0-4543-90bb-797fc21bb944 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:14.690534 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-d39b118c-6795-4590-b83f-653183e06c7c tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3770e2e31549417ea8b0f9055a128bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600c4b4e2bf461f8716f080c94c58a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:14.711804 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-d39b118c-6795-4590-b83f-653183e06c7c tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] 10.222.0.110 "GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066" status: 200 len: 1276 microversion: 2.1 time: 0.162310 Feb 16 14:29:14.712415 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 302/559] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:14 2022] GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066 => generated 1276 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:14.996524 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f46ba7df-8fc0-4543-90bb-797fc21bb944 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:15.004408 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f46ba7df-8fc0-4543-90bb-797fc21bb944 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1679 microversion: 2.1 time: 0.369249 Feb 16 14:29:15.004990 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 258/560] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:14 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1679 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:29:15.259917 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-23f85d68-e2af-4e8b-8ba3-9afbb15c9a41 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:15.260942 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-23f85d68-e2af-4e8b-8ba3-9afbb15c9a41 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: 7a7441d1-fed1-484d-8802-a1ef5e016198] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:15.274048 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-23f85d68-e2af-4e8b-8ba3-9afbb15c9a41 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:15.274508 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-23f85d68-e2af-4e8b-8ba3-9afbb15c9a41 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:15.280525 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-23f85d68-e2af-4e8b-8ba3-9afbb15c9a41 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:15.281161 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-23f85d68-e2af-4e8b-8ba3-9afbb15c9a41 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:15.534145 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-23f85d68-e2af-4e8b-8ba3-9afbb15c9a41 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:15.546921 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-23f85d68-e2af-4e8b-8ba3-9afbb15c9a41 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198" status: 200 len: 1322 microversion: 2.1 time: 0.293173 Feb 16 14:29:15.556849 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 303/561] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:15 2022] GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198 => generated 1322 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:15.733801 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-58ee809a-775a-4758-a860-9718ea9049a8 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:15.736633 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-58ee809a-775a-4758-a860-9718ea9049a8 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] [instance: 9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:15.757641 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-58ee809a-775a-4758-a860-9718ea9049a8 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:15.757844 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-58ee809a-775a-4758-a860-9718ea9049a8 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:15.758683 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-58ee809a-775a-4758-a860-9718ea9049a8 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:15.759136 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-58ee809a-775a-4758-a860-9718ea9049a8 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:16.025082 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-0e64ddfb-e925-4f5b-b31e-18a2c8300505 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:16.025679 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-0e64ddfb-e925-4f5b-b31e-18a2c8300505 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:16.036116 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0e64ddfb-e925-4f5b-b31e-18a2c8300505 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:16.036563 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0e64ddfb-e925-4f5b-b31e-18a2c8300505 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:16.038065 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0e64ddfb-e925-4f5b-b31e-18a2c8300505 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:16.038746 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0e64ddfb-e925-4f5b-b31e-18a2c8300505 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:16.233870 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-58ee809a-775a-4758-a860-9718ea9049a8 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3770e2e31549417ea8b0f9055a128bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600c4b4e2bf461f8716f080c94c58a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:16.247015 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-58ee809a-775a-4758-a860-9718ea9049a8 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] 10.222.0.110 "GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066" status: 200 len: 1318 microversion: 2.1 time: 0.518666 Feb 16 14:29:16.250735 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 259/562] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:15 2022] GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066 => generated 1318 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:16.263794 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-69fe1f71-216f-4827-8a6c-517171ada856 req-a008f125-6072-41e1-8894-3584efc94766 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a7441d1-fed1-484d-8802-a1ef5e016198", "tag": "1fb6bfc4-5c28-4aa7-afef-dea28a833f1c"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:29:16.293352 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:29:16.293352 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: warnings.warn(msg) Feb 16 14:29:16.323253 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-69fe1f71-216f-4827-8a6c-517171ada856 req-a008f125-6072-41e1-8894-3584efc94766 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:16.324420 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-69fe1f71-216f-4827-8a6c-517171ada856 req-a008f125-6072-41e1-8894-3584efc94766 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:16.371299 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-69fe1f71-216f-4827-8a6c-517171ada856 req-a008f125-6072-41e1-8894-3584efc94766 service nova] Creating event network-changed:1fb6bfc4-5c28-4aa7-afef-dea28a833f1c for instance 7a7441d1-fed1-484d-8802-a1ef5e016198 on hv-cinder-80473 Feb 16 14:29:16.378917 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-0e64ddfb-e925-4f5b-b31e-18a2c8300505 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:16.389130 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-0e64ddfb-e925-4f5b-b31e-18a2c8300505 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1679 microversion: 2.1 time: 0.367646 Feb 16 14:29:16.391548 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 304/563] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:16 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1679 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:29:16.392433 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-69fe1f71-216f-4827-8a6c-517171ada856 req-a008f125-6072-41e1-8894-3584efc94766 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137905 Feb 16 14:29:16.393703 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 260/564] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:29:16.566291 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-0f30acb1-367f-43b8-955e-76085c71ee6d tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:16.570239 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-0f30acb1-367f-43b8-955e-76085c71ee6d tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: 7a7441d1-fed1-484d-8802-a1ef5e016198] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:16.583615 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0f30acb1-367f-43b8-955e-76085c71ee6d tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:16.590281 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0f30acb1-367f-43b8-955e-76085c71ee6d tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:16.591628 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0f30acb1-367f-43b8-955e-76085c71ee6d tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:16.591786 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0f30acb1-367f-43b8-955e-76085c71ee6d tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:16.937539 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-0f30acb1-367f-43b8-955e-76085c71ee6d tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:16.946731 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-0f30acb1-367f-43b8-955e-76085c71ee6d tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198" status: 200 len: 1322 microversion: 2.1 time: 0.386012 Feb 16 14:29:16.947315 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 305/565] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:16 2022] GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198 => generated 1322 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:29:17.274124 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b7f88562-1eec-439f-9668-594c82e62d4a tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:17.275490 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b7f88562-1eec-439f-9668-594c82e62d4a tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] [instance: 9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:17.290874 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b7f88562-1eec-439f-9668-594c82e62d4a tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:17.292863 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b7f88562-1eec-439f-9668-594c82e62d4a tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:17.294512 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b7f88562-1eec-439f-9668-594c82e62d4a tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:17.297291 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b7f88562-1eec-439f-9668-594c82e62d4a tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:17.413836 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-32846a54-638f-4e49-b947-8266be5f0a1f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:17.414455 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-32846a54-638f-4e49-b947-8266be5f0a1f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:17.424110 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-32846a54-638f-4e49-b947-8266be5f0a1f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:17.424947 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-32846a54-638f-4e49-b947-8266be5f0a1f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:17.425885 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-32846a54-638f-4e49-b947-8266be5f0a1f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:17.426344 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-32846a54-638f-4e49-b947-8266be5f0a1f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:17.462618 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b7f88562-1eec-439f-9668-594c82e62d4a tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3770e2e31549417ea8b0f9055a128bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600c4b4e2bf461f8716f080c94c58a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:17.470733 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b7f88562-1eec-439f-9668-594c82e62d4a tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] 10.222.0.110 "GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066" status: 200 len: 1318 microversion: 2.1 time: 0.202489 Feb 16 14:29:17.471409 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 261/566] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:17 2022] GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066 => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:17.617369 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-32846a54-638f-4e49-b947-8266be5f0a1f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:17.625109 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-32846a54-638f-4e49-b947-8266be5f0a1f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1679 microversion: 2.1 time: 0.215657 Feb 16 14:29:17.626972 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 306/567] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:17 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1679 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:17.964288 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-365db44c-5a29-4ba4-a05c-316d560b8c6c tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:17.965034 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-365db44c-5a29-4ba4-a05c-316d560b8c6c tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: 7a7441d1-fed1-484d-8802-a1ef5e016198] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:17.971299 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-365db44c-5a29-4ba4-a05c-316d560b8c6c tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:17.971759 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-365db44c-5a29-4ba4-a05c-316d560b8c6c tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:17.972600 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-365db44c-5a29-4ba4-a05c-316d560b8c6c tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:17.973371 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-365db44c-5a29-4ba4-a05c-316d560b8c6c tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:18.131800 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-365db44c-5a29-4ba4-a05c-316d560b8c6c tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:18.140065 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-365db44c-5a29-4ba4-a05c-316d560b8c6c tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198" status: 200 len: 1322 microversion: 2.1 time: 0.179813 Feb 16 14:29:18.140648 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 262/568] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:17 2022] GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:18.402923 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-401a2a61-ae10-464d-b9a6-e4935822205a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2026635442", "imageRef": "2493d2dc-e081-43d3-8292-91b4762a21e8", "flavorRef": "452", "networks": [{"uuid": "36f39343-766a-4d7f-8597-906aa4ce6697"}]}} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:29:18.425346 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-e8f302d4-05c5-4400-99e3-59c72a91c5e1 req-bba52810-1473-4fe0-8150-998439057700 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066", "tag": "42f071db-c04b-47df-ad6b-af38a1d48626"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:29:18.426923 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:29:18.426923 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: warnings.warn(msg) Feb 16 14:29:18.434709 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-e8f302d4-05c5-4400-99e3-59c72a91c5e1 req-bba52810-1473-4fe0-8150-998439057700 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:18.435158 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-e8f302d4-05c5-4400-99e3-59c72a91c5e1 req-bba52810-1473-4fe0-8150-998439057700 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:18.447084 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-e8f302d4-05c5-4400-99e3-59c72a91c5e1 req-bba52810-1473-4fe0-8150-998439057700 service nova] Creating event network-changed:42f071db-c04b-47df-ad6b-af38a1d48626 for instance 9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066 on hv-cinder-80473 Feb 16 14:29:18.451950 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-e8f302d4-05c5-4400-99e3-59c72a91c5e1 req-bba52810-1473-4fe0-8150-998439057700 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030134 Feb 16 14:29:18.452553 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 263/569] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 14:29:18.455641 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.network.neutron [None req-401a2a61-ae10-464d-b9a6-e4935822205a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] validate_networks() for [('36f39343-766a-4d7f-8597-906aa4ce6697', None, None, None, None, None)] {{(pid=117031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 16 14:29:18.488226 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ba341a71-e4ea-4862-b433-22018bc403e3 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:18.489603 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ba341a71-e4ea-4862-b433-22018bc403e3 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] [instance: 9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:18.496484 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ba341a71-e4ea-4862-b433-22018bc403e3 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:18.497229 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ba341a71-e4ea-4862-b433-22018bc403e3 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:18.497948 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ba341a71-e4ea-4862-b433-22018bc403e3 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:18.498458 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ba341a71-e4ea-4862-b433-22018bc403e3 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:18.639463 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ba341a71-e4ea-4862-b433-22018bc403e3 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3770e2e31549417ea8b0f9055a128bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600c4b4e2bf461f8716f080c94c58a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:18.648187 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ba341a71-e4ea-4862-b433-22018bc403e3 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] 10.222.0.110 "GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066" status: 200 len: 1318 microversion: 2.1 time: 0.162601 Feb 16 14:29:18.649954 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 264/570] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:18 2022] GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:29:18.654337 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-88c96686-b516-4169-932c-ad7f6e7f937a tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:18.655155 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-88c96686-b516-4169-932c-ad7f6e7f937a tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:18.660720 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-88c96686-b516-4169-932c-ad7f6e7f937a tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:18.661798 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-88c96686-b516-4169-932c-ad7f6e7f937a tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:18.662834 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-88c96686-b516-4169-932c-ad7f6e7f937a tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:18.663289 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-88c96686-b516-4169-932c-ad7f6e7f937a tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:18.801433 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-88c96686-b516-4169-932c-ad7f6e7f937a tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:18.810141 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-88c96686-b516-4169-932c-ad7f6e7f937a tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1679 microversion: 2.1 time: 0.159270 Feb 16 14:29:18.810737 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 265/571] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:18 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:18.815652 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-401a2a61-ae10-464d-b9a6-e4935822205a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Flavor limits 0:0:0 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 16 14:29:18.816100 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-401a2a61-ae10-464d-b9a6-e4935822205a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Image limits 0:0:0 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 16 14:29:18.816572 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-401a2a61-ae10-464d-b9a6-e4935822205a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Flavor pref 0:0:0 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 16 14:29:18.817597 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-401a2a61-ae10-464d-b9a6-e4935822205a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Image pref 0:0:0 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 16 14:29:18.817970 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-401a2a61-ae10-464d-b9a6-e4935822205a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 16 14:29:18.827326 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-401a2a61-ae10-464d-b9a6-e4935822205a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:18.827772 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-401a2a61-ae10-464d-b9a6-e4935822205a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:18.828838 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-401a2a61-ae10-464d-b9a6-e4935822205a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:18.829273 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-401a2a61-ae10-464d-b9a6-e4935822205a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:18.849899 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.quota [None req-401a2a61-ae10-464d-b9a6-e4935822205a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Getting quotas for project f334385dc44348ac9942c6606482330e. Resources: {'cores', 'instances', 'ram'} {{(pid=117031) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 14:29:18.854203 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.quota [None req-401a2a61-ae10-464d-b9a6-e4935822205a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Getting quotas for user cd0569c12f1740b9a4fab4e6a15f25ed and project f334385dc44348ac9942c6606482330e. Resources: {'cores', 'instances', 'ram'} {{(pid=117031) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 14:29:18.865289 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-401a2a61-ae10-464d-b9a6-e4935822205a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Going to run 1 instances... {{(pid=117031) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 16 14:29:18.868556 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-401a2a61-ae10-464d-b9a6-e4935822205a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f8777fc7-22f6-4dcf-885c-c08aa877b001] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2493d2dc-e081-43d3-8292-91b4762a21e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 16 14:29:19.005138 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-401a2a61-ae10-464d-b9a6-e4935822205a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.711999 Feb 16 14:29:19.005827 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 307/572] 10.222.0.110 () {60 vars in 1151 bytes} [Wed Feb 16 14:29:18 2022] POST /compute/v2.1/servers => generated 382 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Feb 16 14:29:19.018079 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b03af41b-680e-41e0-8b37-e07932362919 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:19.018970 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b03af41b-680e-41e0-8b37-e07932362919 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f8777fc7-22f6-4dcf-885c-c08aa877b001] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:19.069694 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b03af41b-680e-41e0-8b37-e07932362919 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:19.076123 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b03af41b-680e-41e0-8b37-e07932362919 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001" status: 200 len: 1222 microversion: 2.1 time: 0.061671 Feb 16 14:29:19.076677 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 266/573] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:19 2022] GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001 => generated 1222 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:19.165404 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-66fa8fb0-6002-4ad5-bcc3-8cf134ca1c31 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:19.166028 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-66fa8fb0-6002-4ad5-bcc3-8cf134ca1c31 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: 7a7441d1-fed1-484d-8802-a1ef5e016198] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:19.172193 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-66fa8fb0-6002-4ad5-bcc3-8cf134ca1c31 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:19.172641 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-66fa8fb0-6002-4ad5-bcc3-8cf134ca1c31 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:19.174446 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-66fa8fb0-6002-4ad5-bcc3-8cf134ca1c31 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:19.174446 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-66fa8fb0-6002-4ad5-bcc3-8cf134ca1c31 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:19.319530 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-66fa8fb0-6002-4ad5-bcc3-8cf134ca1c31 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:19.326854 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-66fa8fb0-6002-4ad5-bcc3-8cf134ca1c31 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198" status: 200 len: 1322 microversion: 2.1 time: 0.165607 Feb 16 14:29:19.327417 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 308/574] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:19 2022] GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:19.669505 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-d2f0e801-0ed8-45b9-9cd8-4de7ed74a9eb tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:19.671096 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-d2f0e801-0ed8-45b9-9cd8-4de7ed74a9eb tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] [instance: 9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:19.681550 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d2f0e801-0ed8-45b9-9cd8-4de7ed74a9eb tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:19.682257 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d2f0e801-0ed8-45b9-9cd8-4de7ed74a9eb tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:19.683256 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d2f0e801-0ed8-45b9-9cd8-4de7ed74a9eb tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:19.684541 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d2f0e801-0ed8-45b9-9cd8-4de7ed74a9eb tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:19.831899 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-47155810-91c1-40ac-982e-6807ece4f025 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:19.833147 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-47155810-91c1-40ac-982e-6807ece4f025 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:19.846934 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-47155810-91c1-40ac-982e-6807ece4f025 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:19.848177 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-47155810-91c1-40ac-982e-6807ece4f025 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:19.850510 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-47155810-91c1-40ac-982e-6807ece4f025 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:19.851646 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-47155810-91c1-40ac-982e-6807ece4f025 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:20.122019 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-47155810-91c1-40ac-982e-6807ece4f025 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:20.131738 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-47155810-91c1-40ac-982e-6807ece4f025 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1679 microversion: 2.1 time: 0.305335 Feb 16 14:29:20.132675 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 309/575] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:19 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1679 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:29:20.140439 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-274d87b6-cfbe-479a-a56a-48c6f3d9b097 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:20.145888 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-274d87b6-cfbe-479a-a56a-48c6f3d9b097 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f8777fc7-22f6-4dcf-885c-c08aa877b001] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:20.154265 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-274d87b6-cfbe-479a-a56a-48c6f3d9b097 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:20.154797 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-274d87b6-cfbe-479a-a56a-48c6f3d9b097 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:20.155601 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-274d87b6-cfbe-479a-a56a-48c6f3d9b097 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:20.156036 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-274d87b6-cfbe-479a-a56a-48c6f3d9b097 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:20.204729 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d2f0e801-0ed8-45b9-9cd8-4de7ed74a9eb tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3770e2e31549417ea8b0f9055a128bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600c4b4e2bf461f8716f080c94c58a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:20.216007 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-d2f0e801-0ed8-45b9-9cd8-4de7ed74a9eb tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] 10.222.0.110 "GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066" status: 200 len: 1318 microversion: 2.1 time: 0.554870 Feb 16 14:29:20.217835 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 267/576] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:19 2022] GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066 => generated 1318 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:20.270874 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-274d87b6-cfbe-479a-a56a-48c6f3d9b097 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:20.285840 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-274d87b6-cfbe-479a-a56a-48c6f3d9b097 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001" status: 200 len: 1226 microversion: 2.1 time: 0.150664 Feb 16 14:29:20.285840 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 310/577] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:20 2022] GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001 => generated 1226 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:20.343959 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-44367fbc-4b82-41f3-95b2-e05af093c870 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:20.344637 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-44367fbc-4b82-41f3-95b2-e05af093c870 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: 7a7441d1-fed1-484d-8802-a1ef5e016198] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:20.357415 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-44367fbc-4b82-41f3-95b2-e05af093c870 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:20.358562 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-44367fbc-4b82-41f3-95b2-e05af093c870 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:20.361061 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-44367fbc-4b82-41f3-95b2-e05af093c870 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:20.362169 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-44367fbc-4b82-41f3-95b2-e05af093c870 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:20.672596 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-44367fbc-4b82-41f3-95b2-e05af093c870 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:20.680942 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-44367fbc-4b82-41f3-95b2-e05af093c870 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198" status: 200 len: 1322 microversion: 2.1 time: 0.340808 Feb 16 14:29:20.682022 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 268/578] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:20 2022] GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198 => generated 1322 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:21.153089 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-48cea96e-dfef-47db-b2a9-bbe767048ac2 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:21.153711 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-48cea96e-dfef-47db-b2a9-bbe767048ac2 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:21.161875 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-48cea96e-dfef-47db-b2a9-bbe767048ac2 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:21.163737 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-48cea96e-dfef-47db-b2a9-bbe767048ac2 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:21.165588 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-48cea96e-dfef-47db-b2a9-bbe767048ac2 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:21.166821 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-48cea96e-dfef-47db-b2a9-bbe767048ac2 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:21.241994 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-28339d64-331a-429a-b677-a3625d4329c2 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:21.242674 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-28339d64-331a-429a-b677-a3625d4329c2 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] [instance: 9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:21.249648 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-28339d64-331a-429a-b677-a3625d4329c2 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:21.250112 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-28339d64-331a-429a-b677-a3625d4329c2 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:21.250946 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-28339d64-331a-429a-b677-a3625d4329c2 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:21.251420 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-28339d64-331a-429a-b677-a3625d4329c2 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:21.322988 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-48cea96e-dfef-47db-b2a9-bbe767048ac2 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:21.331274 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-48cea96e-dfef-47db-b2a9-bbe767048ac2 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1679 microversion: 2.1 time: 0.182000 Feb 16 14:29:21.341772 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 311/579] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:21 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1679 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:21.347198 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-00dd5621-9f66-4731-98ff-604887894314 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:21.347198 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-00dd5621-9f66-4731-98ff-604887894314 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f8777fc7-22f6-4dcf-885c-c08aa877b001] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:21.354092 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-00dd5621-9f66-4731-98ff-604887894314 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:21.354849 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-00dd5621-9f66-4731-98ff-604887894314 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:21.355873 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-00dd5621-9f66-4731-98ff-604887894314 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:21.356384 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-00dd5621-9f66-4731-98ff-604887894314 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:21.447631 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-00dd5621-9f66-4731-98ff-604887894314 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:21.460850 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-28339d64-331a-429a-b677-a3625d4329c2 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3770e2e31549417ea8b0f9055a128bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600c4b4e2bf461f8716f080c94c58a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:21.461163 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-00dd5621-9f66-4731-98ff-604887894314 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001" status: 200 len: 1274 microversion: 2.1 time: 0.128136 Feb 16 14:29:21.461757 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 312/580] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:21 2022] GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001 => generated 1274 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:21.469331 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-28339d64-331a-429a-b677-a3625d4329c2 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] 10.222.0.110 "GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066" status: 200 len: 1318 microversion: 2.1 time: 0.236385 Feb 16 14:29:21.471950 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 269/581] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:21 2022] GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:29:21.699826 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-d1466d8d-41e7-4398-931d-051f9d307c53 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:21.700314 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-d1466d8d-41e7-4398-931d-051f9d307c53 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: 7a7441d1-fed1-484d-8802-a1ef5e016198] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:21.709677 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d1466d8d-41e7-4398-931d-051f9d307c53 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:21.710598 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d1466d8d-41e7-4398-931d-051f9d307c53 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:21.711339 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d1466d8d-41e7-4398-931d-051f9d307c53 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:21.711974 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d1466d8d-41e7-4398-931d-051f9d307c53 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:21.894225 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-d1466d8d-41e7-4398-931d-051f9d307c53 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:21.905834 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-d1466d8d-41e7-4398-931d-051f9d307c53 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198" status: 200 len: 1322 microversion: 2.1 time: 0.209849 Feb 16 14:29:21.916579 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 313/582] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:21 2022] GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:22.349975 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-18cbcfbc-b977-459f-95a1-aefb6397dde6 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:22.352420 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-18cbcfbc-b977-459f-95a1-aefb6397dde6 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:22.359874 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-18cbcfbc-b977-459f-95a1-aefb6397dde6 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:22.360583 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-18cbcfbc-b977-459f-95a1-aefb6397dde6 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:22.361606 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-18cbcfbc-b977-459f-95a1-aefb6397dde6 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:22.362347 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-18cbcfbc-b977-459f-95a1-aefb6397dde6 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:22.480315 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-028330e0-c524-47d9-9f4c-59394a4df548 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:22.481675 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-028330e0-c524-47d9-9f4c-59394a4df548 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f8777fc7-22f6-4dcf-885c-c08aa877b001] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:22.489783 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-028330e0-c524-47d9-9f4c-59394a4df548 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:22.490975 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-028330e0-c524-47d9-9f4c-59394a4df548 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:22.492651 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-028330e0-c524-47d9-9f4c-59394a4df548 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:22.494998 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-028330e0-c524-47d9-9f4c-59394a4df548 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:22.577360 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-028330e0-c524-47d9-9f4c-59394a4df548 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:22.585895 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-028330e0-c524-47d9-9f4c-59394a4df548 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001" status: 200 len: 1280 microversion: 2.1 time: 0.111134 Feb 16 14:29:22.586651 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 314/583] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:22 2022] GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001 => generated 1280 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:22.591059 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-1f34abd4-8ba1-4e55-ae2f-1d656e6cb726 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:22.592121 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-1f34abd4-8ba1-4e55-ae2f-1d656e6cb726 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] [instance: 9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:22.597338 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1f34abd4-8ba1-4e55-ae2f-1d656e6cb726 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:22.597783 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1f34abd4-8ba1-4e55-ae2f-1d656e6cb726 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:22.598557 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1f34abd4-8ba1-4e55-ae2f-1d656e6cb726 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:22.599014 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1f34abd4-8ba1-4e55-ae2f-1d656e6cb726 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:22.669893 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-18cbcfbc-b977-459f-95a1-aefb6397dde6 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:22.677567 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-18cbcfbc-b977-459f-95a1-aefb6397dde6 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1679 microversion: 2.1 time: 0.332133 Feb 16 14:29:22.678451 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 270/584] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:22 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1679 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:22.746771 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-1f34abd4-8ba1-4e55-ae2f-1d656e6cb726 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3770e2e31549417ea8b0f9055a128bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600c4b4e2bf461f8716f080c94c58a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:22.749501 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-1f34abd4-8ba1-4e55-ae2f-1d656e6cb726 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] 10.222.0.110 "GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066" status: 200 len: 1318 microversion: 2.1 time: 0.161639 Feb 16 14:29:22.750336 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 315/585] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:22 2022] GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:22.924138 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-370fcefc-38aa-4075-ab98-e75592ea4859 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:22.925674 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-370fcefc-38aa-4075-ab98-e75592ea4859 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: 7a7441d1-fed1-484d-8802-a1ef5e016198] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:22.932425 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-370fcefc-38aa-4075-ab98-e75592ea4859 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:22.932973 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-370fcefc-38aa-4075-ab98-e75592ea4859 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:22.933849 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-370fcefc-38aa-4075-ab98-e75592ea4859 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:22.934358 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-370fcefc-38aa-4075-ab98-e75592ea4859 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:23.220221 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-370fcefc-38aa-4075-ab98-e75592ea4859 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:23.226257 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-370fcefc-38aa-4075-ab98-e75592ea4859 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198" status: 200 len: 1322 microversion: 2.1 time: 0.305843 Feb 16 14:29:23.226842 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 271/586] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:22 2022] GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198 => generated 1322 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:23.607221 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-5f152e26-7fb2-42ad-ac2b-96d0663ae6cd tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:23.608765 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-5f152e26-7fb2-42ad-ac2b-96d0663ae6cd tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f8777fc7-22f6-4dcf-885c-c08aa877b001] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:23.619763 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5f152e26-7fb2-42ad-ac2b-96d0663ae6cd tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:23.620648 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5f152e26-7fb2-42ad-ac2b-96d0663ae6cd tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:23.621646 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5f152e26-7fb2-42ad-ac2b-96d0663ae6cd tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:23.623193 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5f152e26-7fb2-42ad-ac2b-96d0663ae6cd tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:23.696217 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f4dcc17b-9283-4554-a99c-6c8e76b14418 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:23.697424 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f4dcc17b-9283-4554-a99c-6c8e76b14418 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:23.706274 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f4dcc17b-9283-4554-a99c-6c8e76b14418 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:23.706766 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f4dcc17b-9283-4554-a99c-6c8e76b14418 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:23.707568 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f4dcc17b-9283-4554-a99c-6c8e76b14418 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:23.708012 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f4dcc17b-9283-4554-a99c-6c8e76b14418 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:23.813974 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-5f152e26-7fb2-42ad-ac2b-96d0663ae6cd tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:23.822253 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-5f152e26-7fb2-42ad-ac2b-96d0663ae6cd tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001" status: 200 len: 1322 microversion: 2.1 time: 0.219002 Feb 16 14:29:23.823631 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 316/587] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:23 2022] GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:23.829153 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-d79e5192-45bf-4dcd-9e97-b8d567f8e9cd tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:23.829680 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-d79e5192-45bf-4dcd-9e97-b8d567f8e9cd tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] [instance: 9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:23.837227 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d79e5192-45bf-4dcd-9e97-b8d567f8e9cd tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:23.837688 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d79e5192-45bf-4dcd-9e97-b8d567f8e9cd tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:23.838487 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d79e5192-45bf-4dcd-9e97-b8d567f8e9cd tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:23.838946 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d79e5192-45bf-4dcd-9e97-b8d567f8e9cd tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:24.011213 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f4dcc17b-9283-4554-a99c-6c8e76b14418 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:24.018776 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f4dcc17b-9283-4554-a99c-6c8e76b14418 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1679 microversion: 2.1 time: 0.328272 Feb 16 14:29:24.023009 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 272/588] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:23 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1679 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:24.047991 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-d79e5192-45bf-4dcd-9e97-b8d567f8e9cd tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3770e2e31549417ea8b0f9055a128bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600c4b4e2bf461f8716f080c94c58a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:24.056400 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-d79e5192-45bf-4dcd-9e97-b8d567f8e9cd tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] 10.222.0.110 "GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066" status: 200 len: 1318 microversion: 2.1 time: 0.231717 Feb 16 14:29:24.056987 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 317/589] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:23 2022] GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:24.243970 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-2df0a1b4-d2bb-4996-a502-74c5276f60e4 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:24.245032 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-2df0a1b4-d2bb-4996-a502-74c5276f60e4 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: 7a7441d1-fed1-484d-8802-a1ef5e016198] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:24.252402 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2df0a1b4-d2bb-4996-a502-74c5276f60e4 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:24.256772 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2df0a1b4-d2bb-4996-a502-74c5276f60e4 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:24.256772 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2df0a1b4-d2bb-4996-a502-74c5276f60e4 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:24.256772 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2df0a1b4-d2bb-4996-a502-74c5276f60e4 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:24.438683 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-2df0a1b4-d2bb-4996-a502-74c5276f60e4 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:24.446917 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-2df0a1b4-d2bb-4996-a502-74c5276f60e4 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198" status: 200 len: 1322 microversion: 2.1 time: 0.207418 Feb 16 14:29:24.447489 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 273/590] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:24 2022] GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:24.515865 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-312c7a79-8ae8-4fde-860d-861864b9c43f req-1d3b416d-ca1c-43ab-a145-46589c45cd9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8777fc7-22f6-4dcf-885c-c08aa877b001", "tag": "68d05aef-cbdf-4b91-a018-b6666d02255e"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:29:24.517437 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:29:24.517437 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:29:24.524488 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-312c7a79-8ae8-4fde-860d-861864b9c43f req-1d3b416d-ca1c-43ab-a145-46589c45cd9c service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:24.525144 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-312c7a79-8ae8-4fde-860d-861864b9c43f req-1d3b416d-ca1c-43ab-a145-46589c45cd9c service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:24.536698 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-312c7a79-8ae8-4fde-860d-861864b9c43f req-1d3b416d-ca1c-43ab-a145-46589c45cd9c service nova] Creating event network-changed:68d05aef-cbdf-4b91-a018-b6666d02255e for instance f8777fc7-22f6-4dcf-885c-c08aa877b001 on hv-cinder-80473 Feb 16 14:29:24.542443 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-312c7a79-8ae8-4fde-860d-861864b9c43f req-1d3b416d-ca1c-43ab-a145-46589c45cd9c service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030402 Feb 16 14:29:24.543239 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 318/591] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:29:24.840696 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-38de29e1-8a33-452b-b496-5ddc170641ed tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:24.842032 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-38de29e1-8a33-452b-b496-5ddc170641ed tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f8777fc7-22f6-4dcf-885c-c08aa877b001] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:24.848712 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-38de29e1-8a33-452b-b496-5ddc170641ed tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:24.849511 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-38de29e1-8a33-452b-b496-5ddc170641ed tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:24.850316 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-38de29e1-8a33-452b-b496-5ddc170641ed tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:24.850853 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-38de29e1-8a33-452b-b496-5ddc170641ed tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:25.039364 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-097ca149-a93e-442c-87d2-23bbe96ce639 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:25.040134 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-097ca149-a93e-442c-87d2-23bbe96ce639 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:25.040459 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-38de29e1-8a33-452b-b496-5ddc170641ed tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:25.046536 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-097ca149-a93e-442c-87d2-23bbe96ce639 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:25.047034 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-097ca149-a93e-442c-87d2-23bbe96ce639 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:25.047808 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-097ca149-a93e-442c-87d2-23bbe96ce639 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:25.048239 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-097ca149-a93e-442c-87d2-23bbe96ce639 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:25.048357 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-38de29e1-8a33-452b-b496-5ddc170641ed tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001" status: 200 len: 1322 microversion: 2.1 time: 0.211574 Feb 16 14:29:25.049004 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 274/592] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:24 2022] GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:25.074194 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-d45b4d3f-cfb1-413f-97ee-0e0bff96ea8a tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:25.074859 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-d45b4d3f-cfb1-413f-97ee-0e0bff96ea8a tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] [instance: 9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:25.082834 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d45b4d3f-cfb1-413f-97ee-0e0bff96ea8a tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:25.083290 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d45b4d3f-cfb1-413f-97ee-0e0bff96ea8a tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:25.084192 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d45b4d3f-cfb1-413f-97ee-0e0bff96ea8a tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:25.084635 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d45b4d3f-cfb1-413f-97ee-0e0bff96ea8a tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:25.192600 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-097ca149-a93e-442c-87d2-23bbe96ce639 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:25.201624 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-097ca149-a93e-442c-87d2-23bbe96ce639 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1679 microversion: 2.1 time: 0.166711 Feb 16 14:29:25.202200 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 319/593] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:25 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:29:25.334443 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d45b4d3f-cfb1-413f-97ee-0e0bff96ea8a tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3770e2e31549417ea8b0f9055a128bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600c4b4e2bf461f8716f080c94c58a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:25.342546 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-d45b4d3f-cfb1-413f-97ee-0e0bff96ea8a tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] 10.222.0.110 "GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066" status: 200 len: 1318 microversion: 2.1 time: 0.273088 Feb 16 14:29:25.343168 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 275/594] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:25 2022] GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066 => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:25.464602 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-d458bdfa-45ae-4622-9185-49d7da485834 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:25.465214 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-d458bdfa-45ae-4622-9185-49d7da485834 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: 7a7441d1-fed1-484d-8802-a1ef5e016198] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:25.471326 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d458bdfa-45ae-4622-9185-49d7da485834 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:25.474550 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d458bdfa-45ae-4622-9185-49d7da485834 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:25.474550 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d458bdfa-45ae-4622-9185-49d7da485834 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:25.474550 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d458bdfa-45ae-4622-9185-49d7da485834 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:25.606330 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-d458bdfa-45ae-4622-9185-49d7da485834 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:25.613670 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-d458bdfa-45ae-4622-9185-49d7da485834 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198" status: 200 len: 1322 microversion: 2.1 time: 0.153829 Feb 16 14:29:25.614234 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 320/595] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:25 2022] GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:26.067852 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-2b8bd84c-20e4-4864-bbb3-c8e2c3e1529c tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:26.068525 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-2b8bd84c-20e4-4864-bbb3-c8e2c3e1529c tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f8777fc7-22f6-4dcf-885c-c08aa877b001] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:26.074918 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2b8bd84c-20e4-4864-bbb3-c8e2c3e1529c tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:26.075370 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2b8bd84c-20e4-4864-bbb3-c8e2c3e1529c tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:26.076154 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2b8bd84c-20e4-4864-bbb3-c8e2c3e1529c tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:26.076590 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2b8bd84c-20e4-4864-bbb3-c8e2c3e1529c tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:26.212676 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-2b8bd84c-20e4-4864-bbb3-c8e2c3e1529c tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:26.219453 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-1d23791c-0b3d-4cf6-9a8f-4a156dffed87 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:26.220026 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-2b8bd84c-20e4-4864-bbb3-c8e2c3e1529c tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001" status: 200 len: 1322 microversion: 2.1 time: 0.155819 Feb 16 14:29:26.220142 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-1d23791c-0b3d-4cf6-9a8f-4a156dffed87 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:26.220600 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 276/596] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:26 2022] GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:26.225875 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1d23791c-0b3d-4cf6-9a8f-4a156dffed87 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:26.227026 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1d23791c-0b3d-4cf6-9a8f-4a156dffed87 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:26.227818 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1d23791c-0b3d-4cf6-9a8f-4a156dffed87 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:26.228251 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1d23791c-0b3d-4cf6-9a8f-4a156dffed87 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:26.359527 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b866a29a-9c94-41b4-989f-42d1747a093f tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:26.360133 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b866a29a-9c94-41b4-989f-42d1747a093f tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] [instance: 9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:26.366804 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b866a29a-9c94-41b4-989f-42d1747a093f tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:26.366804 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b866a29a-9c94-41b4-989f-42d1747a093f tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:26.367085 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-1d23791c-0b3d-4cf6-9a8f-4a156dffed87 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:26.367484 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b866a29a-9c94-41b4-989f-42d1747a093f tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:26.367925 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b866a29a-9c94-41b4-989f-42d1747a093f tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:26.374591 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-1d23791c-0b3d-4cf6-9a8f-4a156dffed87 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1679 microversion: 2.1 time: 0.158700 Feb 16 14:29:26.375227 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 321/597] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:26 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:29:26.500783 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b866a29a-9c94-41b4-989f-42d1747a093f tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3770e2e31549417ea8b0f9055a128bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600c4b4e2bf461f8716f080c94c58a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:26.509024 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b866a29a-9c94-41b4-989f-42d1747a093f tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] 10.222.0.110 "GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066" status: 200 len: 1318 microversion: 2.1 time: 0.153460 Feb 16 14:29:26.509610 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 277/598] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:26 2022] GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:29:26.630280 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-ff95627b-e5bc-48bb-987d-a85e3a1b3814 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:26.630905 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-ff95627b-e5bc-48bb-987d-a85e3a1b3814 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: 7a7441d1-fed1-484d-8802-a1ef5e016198] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:26.636904 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ff95627b-e5bc-48bb-987d-a85e3a1b3814 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:26.637338 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ff95627b-e5bc-48bb-987d-a85e3a1b3814 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:26.638099 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ff95627b-e5bc-48bb-987d-a85e3a1b3814 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:26.638529 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ff95627b-e5bc-48bb-987d-a85e3a1b3814 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:26.769446 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-ff95627b-e5bc-48bb-987d-a85e3a1b3814 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:26.777023 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-ff95627b-e5bc-48bb-987d-a85e3a1b3814 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198" status: 200 len: 1322 microversion: 2.1 time: 0.150336 Feb 16 14:29:26.777587 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 322/599] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:26 2022] GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:27.237037 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b684d042-c3e4-47a9-8151-c99f3442fe9e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:27.237644 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b684d042-c3e4-47a9-8151-c99f3442fe9e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f8777fc7-22f6-4dcf-885c-c08aa877b001] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:27.244686 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b684d042-c3e4-47a9-8151-c99f3442fe9e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:27.245131 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b684d042-c3e4-47a9-8151-c99f3442fe9e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:27.245905 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b684d042-c3e4-47a9-8151-c99f3442fe9e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:27.246336 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b684d042-c3e4-47a9-8151-c99f3442fe9e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:27.381097 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b684d042-c3e4-47a9-8151-c99f3442fe9e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:27.388947 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b684d042-c3e4-47a9-8151-c99f3442fe9e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001" status: 200 len: 1322 microversion: 2.1 time: 0.155583 Feb 16 14:29:27.389566 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 278/600] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:27 2022] GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:27.391565 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-4fd9dc61-5eba-4b6e-9731-e1b2a410c38b tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:27.392176 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-4fd9dc61-5eba-4b6e-9731-e1b2a410c38b tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:27.397978 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4fd9dc61-5eba-4b6e-9731-e1b2a410c38b tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:27.398468 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4fd9dc61-5eba-4b6e-9731-e1b2a410c38b tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:27.399430 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4fd9dc61-5eba-4b6e-9731-e1b2a410c38b tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:27.399866 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4fd9dc61-5eba-4b6e-9731-e1b2a410c38b tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:27.525289 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-7c5aa536-26ed-440a-931f-cc8da1e27ad6 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:27.526029 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-7c5aa536-26ed-440a-931f-cc8da1e27ad6 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] [instance: 9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:27.532314 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7c5aa536-26ed-440a-931f-cc8da1e27ad6 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:27.532773 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7c5aa536-26ed-440a-931f-cc8da1e27ad6 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:27.533624 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7c5aa536-26ed-440a-931f-cc8da1e27ad6 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:27.534194 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7c5aa536-26ed-440a-931f-cc8da1e27ad6 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:27.534826 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-4fd9dc61-5eba-4b6e-9731-e1b2a410c38b tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:27.543544 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-4fd9dc61-5eba-4b6e-9731-e1b2a410c38b tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1679 microversion: 2.1 time: 0.155777 Feb 16 14:29:27.544123 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 323/601] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:27 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:27.668242 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-7c5aa536-26ed-440a-931f-cc8da1e27ad6 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3770e2e31549417ea8b0f9055a128bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600c4b4e2bf461f8716f080c94c58a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:27.675414 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-7c5aa536-26ed-440a-931f-cc8da1e27ad6 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] 10.222.0.110 "GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066" status: 200 len: 1318 microversion: 2.1 time: 0.153764 Feb 16 14:29:27.675973 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 279/602] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:27 2022] GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:29:27.793290 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-211974c3-0819-4628-bd16-b5c0d7b35191 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:27.793893 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-211974c3-0819-4628-bd16-b5c0d7b35191 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: 7a7441d1-fed1-484d-8802-a1ef5e016198] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:27.799694 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-211974c3-0819-4628-bd16-b5c0d7b35191 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:27.800132 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-211974c3-0819-4628-bd16-b5c0d7b35191 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:27.800982 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-211974c3-0819-4628-bd16-b5c0d7b35191 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:27.801340 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-211974c3-0819-4628-bd16-b5c0d7b35191 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:27.931099 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-211974c3-0819-4628-bd16-b5c0d7b35191 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:27.938157 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-211974c3-0819-4628-bd16-b5c0d7b35191 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198" status: 200 len: 1322 microversion: 2.1 time: 0.148627 Feb 16 14:29:27.938741 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 324/603] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:27 2022] GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:28.405665 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-fe43e0e6-a700-4889-bc71-05ba6b7b0249 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:28.406273 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-fe43e0e6-a700-4889-bc71-05ba6b7b0249 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f8777fc7-22f6-4dcf-885c-c08aa877b001] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:28.412657 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fe43e0e6-a700-4889-bc71-05ba6b7b0249 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:28.413116 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fe43e0e6-a700-4889-bc71-05ba6b7b0249 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:28.413938 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fe43e0e6-a700-4889-bc71-05ba6b7b0249 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:28.414647 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fe43e0e6-a700-4889-bc71-05ba6b7b0249 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:28.546809 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-fe43e0e6-a700-4889-bc71-05ba6b7b0249 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:28.553923 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-fe43e0e6-a700-4889-bc71-05ba6b7b0249 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001" status: 200 len: 1322 microversion: 2.1 time: 0.151936 Feb 16 14:29:28.555046 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 280/604] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:28 2022] GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:28.560380 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-ed21698c-66c3-48f5-ab29-c6d4dea2473e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:28.560986 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-ed21698c-66c3-48f5-ab29-c6d4dea2473e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:28.566930 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ed21698c-66c3-48f5-ab29-c6d4dea2473e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:28.567381 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ed21698c-66c3-48f5-ab29-c6d4dea2473e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:28.568155 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ed21698c-66c3-48f5-ab29-c6d4dea2473e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:28.568713 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ed21698c-66c3-48f5-ab29-c6d4dea2473e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:28.698134 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-46ba105a-340d-4b34-9a5c-e65ad7431494 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:28.698781 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-46ba105a-340d-4b34-9a5c-e65ad7431494 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] [instance: 9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:28.704737 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-46ba105a-340d-4b34-9a5c-e65ad7431494 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:28.705203 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-46ba105a-340d-4b34-9a5c-e65ad7431494 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:28.705999 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-46ba105a-340d-4b34-9a5c-e65ad7431494 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:28.706448 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-46ba105a-340d-4b34-9a5c-e65ad7431494 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:28.714202 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-ed21698c-66c3-48f5-ab29-c6d4dea2473e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:28.721389 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-ed21698c-66c3-48f5-ab29-c6d4dea2473e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1679 microversion: 2.1 time: 0.164572 Feb 16 14:29:28.721961 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 325/605] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:28 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:28.846724 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-46ba105a-340d-4b34-9a5c-e65ad7431494 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3770e2e31549417ea8b0f9055a128bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600c4b4e2bf461f8716f080c94c58a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:28.854679 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-46ba105a-340d-4b34-9a5c-e65ad7431494 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] 10.222.0.110 "GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066" status: 200 len: 1318 microversion: 2.1 time: 0.161346 Feb 16 14:29:28.855246 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 281/606] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:28 2022] GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:28.955902 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-680ad46a-1fe4-4203-a69c-0f5810a1ce12 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:28.956423 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-680ad46a-1fe4-4203-a69c-0f5810a1ce12 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: 7a7441d1-fed1-484d-8802-a1ef5e016198] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:28.962746 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-680ad46a-1fe4-4203-a69c-0f5810a1ce12 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:28.963205 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-680ad46a-1fe4-4203-a69c-0f5810a1ce12 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:28.963981 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-680ad46a-1fe4-4203-a69c-0f5810a1ce12 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:28.964416 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-680ad46a-1fe4-4203-a69c-0f5810a1ce12 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:29.095889 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-680ad46a-1fe4-4203-a69c-0f5810a1ce12 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:29.103605 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-680ad46a-1fe4-4203-a69c-0f5810a1ce12 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198" status: 200 len: 1322 microversion: 2.1 time: 0.151748 Feb 16 14:29:29.104170 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 326/607] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:28 2022] GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:29.571695 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-910117a2-d069-47ab-b615-4bb9f61ed938 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:29.572300 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-910117a2-d069-47ab-b615-4bb9f61ed938 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f8777fc7-22f6-4dcf-885c-c08aa877b001] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:29.578983 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-910117a2-d069-47ab-b615-4bb9f61ed938 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:29.579434 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-910117a2-d069-47ab-b615-4bb9f61ed938 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:29.580242 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-910117a2-d069-47ab-b615-4bb9f61ed938 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:29.580673 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-910117a2-d069-47ab-b615-4bb9f61ed938 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:29.725592 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-910117a2-d069-47ab-b615-4bb9f61ed938 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:29.735600 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-910117a2-d069-47ab-b615-4bb9f61ed938 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001" status: 200 len: 1322 microversion: 2.1 time: 0.168000 Feb 16 14:29:29.741793 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 282/608] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:29 2022] GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:29.741938 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-0719cf67-06f7-4a6e-92c9-1efa4b584a87 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:29.741938 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-0719cf67-06f7-4a6e-92c9-1efa4b584a87 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:29.747291 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0719cf67-06f7-4a6e-92c9-1efa4b584a87 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:29.747734 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0719cf67-06f7-4a6e-92c9-1efa4b584a87 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:29.748783 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0719cf67-06f7-4a6e-92c9-1efa4b584a87 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:29.749311 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0719cf67-06f7-4a6e-92c9-1efa4b584a87 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:29.815287 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-160e32a3-b1ac-4f59-8f18-b5066f7fb97b req-64ee4462-3c22-4a25-a92c-45c8288bb398 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a7441d1-fed1-484d-8802-a1ef5e016198", "name": "network-vif-plugged", "status": "completed", "tag": "1fb6bfc4-5c28-4aa7-afef-dea28a833f1c"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:29:29.817738 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:29:29.817738 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: warnings.warn(msg) Feb 16 14:29:29.825849 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-160e32a3-b1ac-4f59-8f18-b5066f7fb97b req-64ee4462-3c22-4a25-a92c-45c8288bb398 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:29.826717 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-160e32a3-b1ac-4f59-8f18-b5066f7fb97b req-64ee4462-3c22-4a25-a92c-45c8288bb398 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:29.839093 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-160e32a3-b1ac-4f59-8f18-b5066f7fb97b req-64ee4462-3c22-4a25-a92c-45c8288bb398 service nova] Creating event network-vif-plugged:1fb6bfc4-5c28-4aa7-afef-dea28a833f1c for instance 7a7441d1-fed1-484d-8802-a1ef5e016198 on hv-cinder-80473 Feb 16 14:29:29.844135 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-160e32a3-b1ac-4f59-8f18-b5066f7fb97b req-64ee4462-3c22-4a25-a92c-45c8288bb398 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032760 Feb 16 14:29:29.844759 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 283/609] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 14:29:29.873120 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-05fca933-cc37-4a94-9b46-8d0cb76751f9 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:29.874150 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-05fca933-cc37-4a94-9b46-8d0cb76751f9 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] [instance: 9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:29.881991 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-05fca933-cc37-4a94-9b46-8d0cb76751f9 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:29.883693 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-05fca933-cc37-4a94-9b46-8d0cb76751f9 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:29.884974 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-05fca933-cc37-4a94-9b46-8d0cb76751f9 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:29.885902 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-05fca933-cc37-4a94-9b46-8d0cb76751f9 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:30.004893 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-0719cf67-06f7-4a6e-92c9-1efa4b584a87 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:30.015354 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-0719cf67-06f7-4a6e-92c9-1efa4b584a87 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1679 microversion: 2.1 time: 0.280455 Feb 16 14:29:30.016016 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 327/610] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:29 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1679 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:29:30.085150 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-05fca933-cc37-4a94-9b46-8d0cb76751f9 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3770e2e31549417ea8b0f9055a128bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600c4b4e2bf461f8716f080c94c58a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:30.093574 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-05fca933-cc37-4a94-9b46-8d0cb76751f9 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] 10.222.0.110 "GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066" status: 200 len: 1318 microversion: 2.1 time: 0.225425 Feb 16 14:29:30.094165 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 284/611] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:29 2022] GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:29:30.121845 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-92fdeec4-5b6d-431d-85d1-c901c9cb2d82 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:30.122741 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-92fdeec4-5b6d-431d-85d1-c901c9cb2d82 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: 7a7441d1-fed1-484d-8802-a1ef5e016198] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:30.129234 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-92fdeec4-5b6d-431d-85d1-c901c9cb2d82 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:30.129680 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-92fdeec4-5b6d-431d-85d1-c901c9cb2d82 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:30.130462 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-92fdeec4-5b6d-431d-85d1-c901c9cb2d82 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:30.131040 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-92fdeec4-5b6d-431d-85d1-c901c9cb2d82 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:30.312303 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-92fdeec4-5b6d-431d-85d1-c901c9cb2d82 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:30.321196 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-92fdeec4-5b6d-431d-85d1-c901c9cb2d82 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198" status: 200 len: 1322 microversion: 2.1 time: 0.204267 Feb 16 14:29:30.321887 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 328/612] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:30 2022] GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:30.756488 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-aa9a7abb-f35c-44a9-8b12-1d215f8c75a1 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:30.757192 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-aa9a7abb-f35c-44a9-8b12-1d215f8c75a1 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f8777fc7-22f6-4dcf-885c-c08aa877b001] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:30.764522 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-aa9a7abb-f35c-44a9-8b12-1d215f8c75a1 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:30.764936 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-aa9a7abb-f35c-44a9-8b12-1d215f8c75a1 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:30.765770 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-aa9a7abb-f35c-44a9-8b12-1d215f8c75a1 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:30.766425 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-aa9a7abb-f35c-44a9-8b12-1d215f8c75a1 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:30.905873 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-aa9a7abb-f35c-44a9-8b12-1d215f8c75a1 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:30.913241 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-aa9a7abb-f35c-44a9-8b12-1d215f8c75a1 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001" status: 200 len: 1322 microversion: 2.1 time: 0.160710 Feb 16 14:29:30.913810 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 285/613] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:30 2022] GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:31.032984 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-ab4b6764-527e-4b10-9a3b-47b5106e2387 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:31.033763 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-ab4b6764-527e-4b10-9a3b-47b5106e2387 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:31.040332 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ab4b6764-527e-4b10-9a3b-47b5106e2387 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:31.041354 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ab4b6764-527e-4b10-9a3b-47b5106e2387 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:31.042215 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ab4b6764-527e-4b10-9a3b-47b5106e2387 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:31.042556 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ab4b6764-527e-4b10-9a3b-47b5106e2387 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:31.110372 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c8e2517a-027f-4ba8-ba53-ad87b7be0bd9 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:31.110987 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c8e2517a-027f-4ba8-ba53-ad87b7be0bd9 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] [instance: 9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:31.116713 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c8e2517a-027f-4ba8-ba53-ad87b7be0bd9 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:31.117568 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c8e2517a-027f-4ba8-ba53-ad87b7be0bd9 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:31.119248 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c8e2517a-027f-4ba8-ba53-ad87b7be0bd9 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:31.119685 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c8e2517a-027f-4ba8-ba53-ad87b7be0bd9 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:31.174773 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-ab4b6764-527e-4b10-9a3b-47b5106e2387 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:31.184055 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-ab4b6764-527e-4b10-9a3b-47b5106e2387 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1679 microversion: 2.1 time: 0.154897 Feb 16 14:29:31.185004 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 329/614] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:31 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:31.288966 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c8e2517a-027f-4ba8-ba53-ad87b7be0bd9 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3770e2e31549417ea8b0f9055a128bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600c4b4e2bf461f8716f080c94c58a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:31.299508 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c8e2517a-027f-4ba8-ba53-ad87b7be0bd9 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] 10.222.0.110 "GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066" status: 200 len: 1318 microversion: 2.1 time: 0.192642 Feb 16 14:29:31.300219 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 286/615] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:31 2022] GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066 => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:29:31.339053 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-9aca994e-5abb-4719-a407-1f22b3f4dd01 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:31.339653 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-9aca994e-5abb-4719-a407-1f22b3f4dd01 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: 7a7441d1-fed1-484d-8802-a1ef5e016198] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:31.345611 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9aca994e-5abb-4719-a407-1f22b3f4dd01 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:31.346050 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9aca994e-5abb-4719-a407-1f22b3f4dd01 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:31.346855 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9aca994e-5abb-4719-a407-1f22b3f4dd01 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:31.347284 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9aca994e-5abb-4719-a407-1f22b3f4dd01 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:31.715422 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-9aca994e-5abb-4719-a407-1f22b3f4dd01 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:31.722792 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-9aca994e-5abb-4719-a407-1f22b3f4dd01 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198" status: 200 len: 1322 microversion: 2.1 time: 0.387590 Feb 16 14:29:31.732451 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 330/616] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:31 2022] GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198 => generated 1322 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:31.860512 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-30ded161-a085-4cf3-ab5e-e74e3c8672a8 req-35ffd21a-a608-47ee-9478-ff62ac146dfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066", "name": "network-vif-plugged", "status": "completed", "tag": "42f071db-c04b-47df-ad6b-af38a1d48626"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:29:31.862074 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:29:31.862074 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: warnings.warn(msg) Feb 16 14:29:31.869595 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-30ded161-a085-4cf3-ab5e-e74e3c8672a8 req-35ffd21a-a608-47ee-9478-ff62ac146dfc service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:31.870038 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-30ded161-a085-4cf3-ab5e-e74e3c8672a8 req-35ffd21a-a608-47ee-9478-ff62ac146dfc service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:31.880776 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-30ded161-a085-4cf3-ab5e-e74e3c8672a8 req-35ffd21a-a608-47ee-9478-ff62ac146dfc service nova] Creating event network-vif-plugged:42f071db-c04b-47df-ad6b-af38a1d48626 for instance 9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066 on hv-cinder-80473 Feb 16 14:29:31.886233 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-30ded161-a085-4cf3-ab5e-e74e3c8672a8 req-35ffd21a-a608-47ee-9478-ff62ac146dfc service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029576 Feb 16 14:29:31.887129 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 287/617] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:29:31.929044 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-72a05c0d-1aea-4341-8f60-f54f47ef79cf tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:31.934336 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-72a05c0d-1aea-4341-8f60-f54f47ef79cf tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f8777fc7-22f6-4dcf-885c-c08aa877b001] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:31.936341 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-72a05c0d-1aea-4341-8f60-f54f47ef79cf tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:31.936737 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-72a05c0d-1aea-4341-8f60-f54f47ef79cf tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:31.937634 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-72a05c0d-1aea-4341-8f60-f54f47ef79cf tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:31.938063 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-72a05c0d-1aea-4341-8f60-f54f47ef79cf tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:32.085483 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-72a05c0d-1aea-4341-8f60-f54f47ef79cf tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:32.106489 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-72a05c0d-1aea-4341-8f60-f54f47ef79cf tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001" status: 200 len: 1322 microversion: 2.1 time: 0.174908 Feb 16 14:29:32.107545 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 331/618] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:31 2022] GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:32.201743 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-efac189c-1d11-473f-9940-52d95a700c3a tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:32.202381 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-efac189c-1d11-473f-9940-52d95a700c3a tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:32.208705 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-efac189c-1d11-473f-9940-52d95a700c3a tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:32.209151 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-efac189c-1d11-473f-9940-52d95a700c3a tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:32.209923 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-efac189c-1d11-473f-9940-52d95a700c3a tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:32.210357 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-efac189c-1d11-473f-9940-52d95a700c3a tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:32.317570 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-d6dbe0f2-eb06-48bb-8863-b5e661714951 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:32.318329 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-d6dbe0f2-eb06-48bb-8863-b5e661714951 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] [instance: 9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:32.327431 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d6dbe0f2-eb06-48bb-8863-b5e661714951 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:32.328570 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d6dbe0f2-eb06-48bb-8863-b5e661714951 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:32.329606 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d6dbe0f2-eb06-48bb-8863-b5e661714951 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:32.330256 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d6dbe0f2-eb06-48bb-8863-b5e661714951 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:32.415866 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-efac189c-1d11-473f-9940-52d95a700c3a tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:32.424984 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-efac189c-1d11-473f-9940-52d95a700c3a tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1679 microversion: 2.1 time: 0.227447 Feb 16 14:29:32.435455 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 288/619] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:32 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1679 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:29:32.488494 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-d6dbe0f2-eb06-48bb-8863-b5e661714951 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3770e2e31549417ea8b0f9055a128bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600c4b4e2bf461f8716f080c94c58a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:32.495561 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-d6dbe0f2-eb06-48bb-8863-b5e661714951 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] 10.222.0.110 "GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066" status: 200 len: 1318 microversion: 2.1 time: 0.182361 Feb 16 14:29:32.496385 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 332/620] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:32 2022] GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:29:32.739096 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-46fcb301-281d-4c03-af01-94d73cd89da0 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:32.739658 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-46fcb301-281d-4c03-af01-94d73cd89da0 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: 7a7441d1-fed1-484d-8802-a1ef5e016198] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:32.746825 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-46fcb301-281d-4c03-af01-94d73cd89da0 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:32.750555 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-46fcb301-281d-4c03-af01-94d73cd89da0 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:32.750555 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-46fcb301-281d-4c03-af01-94d73cd89da0 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:32.750555 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-46fcb301-281d-4c03-af01-94d73cd89da0 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:32.908802 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-46fcb301-281d-4c03-af01-94d73cd89da0 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:32.917127 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-46fcb301-281d-4c03-af01-94d73cd89da0 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198" status: 200 len: 1512 microversion: 2.1 time: 0.181671 Feb 16 14:29:32.923834 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 289/621] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:32 2022] GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198 => generated 1512 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:32.934303 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-5e548629-fe63-405a-931a-783b9a64a56c tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dbd4104f-94be-427b-b796-47d023155042", "device": "/dev/sdb"}} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:29:32.936011 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-5e548629-fe63-405a-931a-783b9a64a56c tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: 7a7441d1-fed1-484d-8802-a1ef5e016198] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:32.941836 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5e548629-fe63-405a-931a-783b9a64a56c tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:32.942321 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5e548629-fe63-405a-931a-783b9a64a56c tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:32.943141 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5e548629-fe63-405a-931a-783b9a64a56c tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:32.943574 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5e548629-fe63-405a-931a-783b9a64a56c tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:33.124133 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-999fabed-9a05-4266-9814-d304136f3adb tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:33.124747 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-999fabed-9a05-4266-9814-d304136f3adb tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f8777fc7-22f6-4dcf-885c-c08aa877b001] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:33.130693 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-999fabed-9a05-4266-9814-d304136f3adb tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:33.131153 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-999fabed-9a05-4266-9814-d304136f3adb tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:33.131939 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-999fabed-9a05-4266-9814-d304136f3adb tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:33.132436 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-999fabed-9a05-4266-9814-d304136f3adb tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:33.273785 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-999fabed-9a05-4266-9814-d304136f3adb tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:33.281781 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-999fabed-9a05-4266-9814-d304136f3adb tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001" status: 200 len: 1322 microversion: 2.1 time: 0.161291 Feb 16 14:29:33.282320 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 290/622] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:33 2022] GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:29:33.445247 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-74e4d4c5-5cbc-4e48-a3c7-c12abcd168da tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:33.445914 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-74e4d4c5-5cbc-4e48-a3c7-c12abcd168da tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:33.452427 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-74e4d4c5-5cbc-4e48-a3c7-c12abcd168da tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:33.452888 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-74e4d4c5-5cbc-4e48-a3c7-c12abcd168da tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:33.454113 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-74e4d4c5-5cbc-4e48-a3c7-c12abcd168da tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:33.454556 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-74e4d4c5-5cbc-4e48-a3c7-c12abcd168da tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:33.635260 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-74e4d4c5-5cbc-4e48-a3c7-c12abcd168da tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:33.644086 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-74e4d4c5-5cbc-4e48-a3c7-c12abcd168da tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1679 microversion: 2.1 time: 0.204977 Feb 16 14:29:33.644922 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 291/623] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:33 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1679 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:29:33.659662 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-3f909a18-e23c-44f8-9326-ce9de00c8380 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:33.660274 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-3f909a18-e23c-44f8-9326-ce9de00c8380 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] [instance: 9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:33.667075 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3f909a18-e23c-44f8-9326-ce9de00c8380 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:33.667533 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3f909a18-e23c-44f8-9326-ce9de00c8380 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:33.668330 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3f909a18-e23c-44f8-9326-ce9de00c8380 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:33.668765 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3f909a18-e23c-44f8-9326-ce9de00c8380 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:33.806640 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3f909a18-e23c-44f8-9326-ce9de00c8380 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3770e2e31549417ea8b0f9055a128bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600c4b4e2bf461f8716f080c94c58a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:33.821157 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-5e548629-fe63-405a-931a-783b9a64a56c tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "POST /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.890420 Feb 16 14:29:33.824294 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 333/624] 10.222.0.110 () {60 vars in 1327 bytes} [Wed Feb 16 14:29:32 2022] POST /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198/os-volume_attachments => generated 194 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:29:33.832078 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-3f909a18-e23c-44f8-9326-ce9de00c8380 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] 10.222.0.110 "GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066" status: 200 len: 1318 microversion: 2.1 time: 0.174524 Feb 16 14:29:33.843597 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 292/625] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:33 2022] GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:33.903648 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-c63c2e04-2976-4cf8-8664-2dbe49596758 req-a2df0eeb-48c9-48a9-934f-3db9e3686cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8777fc7-22f6-4dcf-885c-c08aa877b001", "name": "network-vif-plugged", "status": "completed", "tag": "68d05aef-cbdf-4b91-a018-b6666d02255e"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:29:33.905211 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:29:33.905211 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:29:33.912803 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-c63c2e04-2976-4cf8-8664-2dbe49596758 req-a2df0eeb-48c9-48a9-934f-3db9e3686cd8 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:33.913244 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-c63c2e04-2976-4cf8-8664-2dbe49596758 req-a2df0eeb-48c9-48a9-934f-3db9e3686cd8 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:33.925934 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-c63c2e04-2976-4cf8-8664-2dbe49596758 req-a2df0eeb-48c9-48a9-934f-3db9e3686cd8 service nova] Creating event network-vif-plugged:68d05aef-cbdf-4b91-a018-b6666d02255e for instance f8777fc7-22f6-4dcf-885c-c08aa877b001 on hv-cinder-80473 Feb 16 14:29:33.933239 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-c63c2e04-2976-4cf8-8664-2dbe49596758 req-a2df0eeb-48c9-48a9-934f-3db9e3686cd8 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033374 Feb 16 14:29:33.939229 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 334/626] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:29:34.298836 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b5d60e40-3c7e-45ea-a80a-efcbb7e3e387 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:34.299536 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b5d60e40-3c7e-45ea-a80a-efcbb7e3e387 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f8777fc7-22f6-4dcf-885c-c08aa877b001] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:34.322203 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b5d60e40-3c7e-45ea-a80a-efcbb7e3e387 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:34.322203 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b5d60e40-3c7e-45ea-a80a-efcbb7e3e387 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:34.322203 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b5d60e40-3c7e-45ea-a80a-efcbb7e3e387 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:34.322203 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b5d60e40-3c7e-45ea-a80a-efcbb7e3e387 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:34.510181 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b5d60e40-3c7e-45ea-a80a-efcbb7e3e387 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:34.517661 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b5d60e40-3c7e-45ea-a80a-efcbb7e3e387 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001" status: 200 len: 1322 microversion: 2.1 time: 0.222675 Feb 16 14:29:34.518228 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 293/627] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:34 2022] GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001 => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:34.662181 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-89966194-35d5-4ca5-b645-ed15779a6178 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:34.662930 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-89966194-35d5-4ca5-b645-ed15779a6178 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:34.670212 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-89966194-35d5-4ca5-b645-ed15779a6178 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:34.671094 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-89966194-35d5-4ca5-b645-ed15779a6178 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:34.672609 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-89966194-35d5-4ca5-b645-ed15779a6178 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:34.673314 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-89966194-35d5-4ca5-b645-ed15779a6178 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:34.835383 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-89966194-35d5-4ca5-b645-ed15779a6178 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:34.851144 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a70e410f-0e53-4a29-b9e1-4c4a9a979da5 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:34.852158 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a70e410f-0e53-4a29-b9e1-4c4a9a979da5 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] [instance: 9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:34.855416 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-89966194-35d5-4ca5-b645-ed15779a6178 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1656 microversion: 2.1 time: 0.197644 Feb 16 14:29:34.856194 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 335/628] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:34 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1656 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:34.859125 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a70e410f-0e53-4a29-b9e1-4c4a9a979da5 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:34.859125 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a70e410f-0e53-4a29-b9e1-4c4a9a979da5 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:34.859766 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a70e410f-0e53-4a29-b9e1-4c4a9a979da5 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:34.860211 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a70e410f-0e53-4a29-b9e1-4c4a9a979da5 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:34.874016 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-9eb56c26-dcdb-4517-b07d-735babbc01a4 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:29:34.882261 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9eb56c26-dcdb-4517-b07d-735babbc01a4 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:34.882789 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9eb56c26-dcdb-4517-b07d-735babbc01a4 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:34.916363 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-9eb56c26-dcdb-4517-b07d-735babbc01a4 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Going to try to start instance {{(pid=117031) start /opt/stack/nova/nova/compute/api.py:2677}} Feb 16 14:29:35.057203 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a70e410f-0e53-4a29-b9e1-4c4a9a979da5 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3770e2e31549417ea8b0f9055a128bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600c4b4e2bf461f8716f080c94c58a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:35.065293 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a70e410f-0e53-4a29-b9e1-4c4a9a979da5 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] 10.222.0.110 "GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066" status: 200 len: 1468 microversion: 2.1 time: 0.218924 Feb 16 14:29:35.067411 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 294/629] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:34 2022] GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066 => generated 1468 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:35.106114 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-7ca3eb7d-df09-413f-9d02-865ebe7c1c2f tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:35.106612 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-7ca3eb7d-df09-413f-9d02-865ebe7c1c2f tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] [instance: 9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:35.112596 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7ca3eb7d-df09-413f-9d02-865ebe7c1c2f tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:35.113052 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7ca3eb7d-df09-413f-9d02-865ebe7c1c2f tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:35.113831 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7ca3eb7d-df09-413f-9d02-865ebe7c1c2f tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:35.114275 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7ca3eb7d-df09-413f-9d02-865ebe7c1c2f tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:35.130105 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-9eb56c26-dcdb-4517-b07d-735babbc01a4 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "POST /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35/action" status: 202 len: 0 microversion: 2.1 time: 0.256528 Feb 16 14:29:35.130105 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 336/630] 10.222.0.110 () {60 vars in 1282 bytes} [Wed Feb 16 14:29:34 2022] POST /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 16 14:29:35.135940 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-01e9104e-96ac-4c8c-be59-adb673f3ff2f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:35.136653 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-01e9104e-96ac-4c8c-be59-adb673f3ff2f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:35.142921 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-01e9104e-96ac-4c8c-be59-adb673f3ff2f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:35.143368 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-01e9104e-96ac-4c8c-be59-adb673f3ff2f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:35.144772 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-01e9104e-96ac-4c8c-be59-adb673f3ff2f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:35.145459 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-01e9104e-96ac-4c8c-be59-adb673f3ff2f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:35.160299 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-7ca3eb7d-df09-413f-9d02-865ebe7c1c2f tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] [instance: 9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066] Going to try to terminate instance {{(pid=117032) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 16 14:29:35.419244 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-01e9104e-96ac-4c8c-be59-adb673f3ff2f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:35.429082 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-01e9104e-96ac-4c8c-be59-adb673f3ff2f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1665 microversion: 2.1 time: 0.297782 Feb 16 14:29:35.431129 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 337/631] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:35 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1665 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:35.506182 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-7ca3eb7d-df09-413f-9d02-865ebe7c1c2f tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] 10.222.0.110 "DELETE /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066" status: 204 len: 0 microversion: 2.1 time: 0.404193 Feb 16 14:29:35.506788 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 295/632] 10.222.0.110 () {58 vars in 1243 bytes} [Wed Feb 16 14:29:35 2022] DELETE /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 16 14:29:35.514913 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-f4dae98c-d474-4c56-bb71-4e5ae5f718f9 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:35.515743 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-f4dae98c-d474-4c56-bb71-4e5ae5f718f9 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] [instance: 9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:35.522659 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f4dae98c-d474-4c56-bb71-4e5ae5f718f9 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:35.525399 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f4dae98c-d474-4c56-bb71-4e5ae5f718f9 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:35.525399 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f4dae98c-d474-4c56-bb71-4e5ae5f718f9 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:35.525399 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f4dae98c-d474-4c56-bb71-4e5ae5f718f9 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:35.536039 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f5f2036e-3083-4163-93be-c45f430a112e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:35.536994 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f5f2036e-3083-4163-93be-c45f430a112e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f8777fc7-22f6-4dcf-885c-c08aa877b001] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:35.543714 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f5f2036e-3083-4163-93be-c45f430a112e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:35.544622 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f5f2036e-3083-4163-93be-c45f430a112e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:35.546038 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f5f2036e-3083-4163-93be-c45f430a112e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:35.546692 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f5f2036e-3083-4163-93be-c45f430a112e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:35.924176 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-f4dae98c-d474-4c56-bb71-4e5ae5f718f9 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3770e2e31549417ea8b0f9055a128bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600c4b4e2bf461f8716f080c94c58a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:35.926445 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-f4dae98c-d474-4c56-bb71-4e5ae5f718f9 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] 10.222.0.110 "GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066" status: 200 len: 1474 microversion: 2.1 time: 0.415045 Feb 16 14:29:35.927380 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 338/633] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:35 2022] GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066 => generated 1474 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:29:36.097685 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f5f2036e-3083-4163-93be-c45f430a112e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:36.106259 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f5f2036e-3083-4163-93be-c45f430a112e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001" status: 200 len: 1322 microversion: 2.1 time: 0.574412 Feb 16 14:29:36.122352 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 296/634] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:35 2022] GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001 => generated 1322 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:29:36.451568 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-50fb2797-d409-4c1f-b99e-54aa78e14f24 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:36.452919 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-50fb2797-d409-4c1f-b99e-54aa78e14f24 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:36.460574 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-50fb2797-d409-4c1f-b99e-54aa78e14f24 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:36.462830 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-50fb2797-d409-4c1f-b99e-54aa78e14f24 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:36.464032 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-50fb2797-d409-4c1f-b99e-54aa78e14f24 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:36.464989 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-50fb2797-d409-4c1f-b99e-54aa78e14f24 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:36.672842 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-50fb2797-d409-4c1f-b99e-54aa78e14f24 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:36.681097 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-50fb2797-d409-4c1f-b99e-54aa78e14f24 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1665 microversion: 2.1 time: 0.237454 Feb 16 14:29:36.681781 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 339/635] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:36 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1665 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:36.943877 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-762fa513-0d25-4f2c-bc0e-4a88c6a48717 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:36.944744 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-762fa513-0d25-4f2c-bc0e-4a88c6a48717 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] [instance: 9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:36.951997 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-762fa513-0d25-4f2c-bc0e-4a88c6a48717 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:36.952339 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-762fa513-0d25-4f2c-bc0e-4a88c6a48717 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:36.954230 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-762fa513-0d25-4f2c-bc0e-4a88c6a48717 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:36.955127 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-762fa513-0d25-4f2c-bc0e-4a88c6a48717 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:37.128899 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-f4a8d300-8e4f-49df-bc2a-32c4b493835d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:37.130034 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-f4a8d300-8e4f-49df-bc2a-32c4b493835d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f8777fc7-22f6-4dcf-885c-c08aa877b001] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:37.136440 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f4a8d300-8e4f-49df-bc2a-32c4b493835d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:37.143201 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f4a8d300-8e4f-49df-bc2a-32c4b493835d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:37.144259 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f4a8d300-8e4f-49df-bc2a-32c4b493835d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:37.144829 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f4a8d300-8e4f-49df-bc2a-32c4b493835d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:37.300599 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-762fa513-0d25-4f2c-bc0e-4a88c6a48717 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3770e2e31549417ea8b0f9055a128bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600c4b4e2bf461f8716f080c94c58a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:37.312939 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-762fa513-0d25-4f2c-bc0e-4a88c6a48717 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] 10.222.0.110 "GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066" status: 200 len: 1474 microversion: 2.1 time: 0.372647 Feb 16 14:29:37.313541 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 297/636] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:36 2022] GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066 => generated 1474 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:37.325707 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-f4a8d300-8e4f-49df-bc2a-32c4b493835d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:37.333629 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-f4a8d300-8e4f-49df-bc2a-32c4b493835d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001" status: 200 len: 1512 microversion: 2.1 time: 0.209170 Feb 16 14:29:37.334388 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 340/637] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:37 2022] GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001 => generated 1512 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:37.699313 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a63e6c84-3c40-42b8-a8b8-8ec658b7810d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:37.700057 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a63e6c84-3c40-42b8-a8b8-8ec658b7810d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:37.706618 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a63e6c84-3c40-42b8-a8b8-8ec658b7810d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:37.707364 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a63e6c84-3c40-42b8-a8b8-8ec658b7810d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:37.708504 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a63e6c84-3c40-42b8-a8b8-8ec658b7810d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:37.716461 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a63e6c84-3c40-42b8-a8b8-8ec658b7810d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:38.056503 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a63e6c84-3c40-42b8-a8b8-8ec658b7810d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:38.065017 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a63e6c84-3c40-42b8-a8b8-8ec658b7810d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1669 microversion: 2.1 time: 0.370472 Feb 16 14:29:38.079715 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 298/638] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:37 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1669 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:38.331084 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-59ab702a-0aee-49d8-90e4-4ee1f9393238 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:38.331903 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-59ab702a-0aee-49d8-90e4-4ee1f9393238 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] [instance: 9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:38.342519 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-59ab702a-0aee-49d8-90e4-4ee1f9393238 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:38.343012 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-59ab702a-0aee-49d8-90e4-4ee1f9393238 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:38.343828 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-59ab702a-0aee-49d8-90e4-4ee1f9393238 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:38.344276 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-59ab702a-0aee-49d8-90e4-4ee1f9393238 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:38.594488 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-59ab702a-0aee-49d8-90e4-4ee1f9393238 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3770e2e31549417ea8b0f9055a128bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600c4b4e2bf461f8716f080c94c58a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:38.606098 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-59ab702a-0aee-49d8-90e4-4ee1f9393238 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] 10.222.0.110 "GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066" status: 200 len: 1474 microversion: 2.1 time: 0.278626 Feb 16 14:29:38.607777 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 341/639] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:38 2022] GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066 => generated 1474 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:38.915164 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-75d35741-66d4-4b80-b555-bc7fe3c15379 req-1755eb05-9394-4b27-9e20-b6ab5b728e67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066", "name": "network-vif-deleted", "tag": "42f071db-c04b-47df-ad6b-af38a1d48626"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:29:38.917369 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:29:38.917369 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: warnings.warn(msg) Feb 16 14:29:38.926299 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-75d35741-66d4-4b80-b555-bc7fe3c15379 req-1755eb05-9394-4b27-9e20-b6ab5b728e67 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:38.927817 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-75d35741-66d4-4b80-b555-bc7fe3c15379 req-1755eb05-9394-4b27-9e20-b6ab5b728e67 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:38.941840 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-75d35741-66d4-4b80-b555-bc7fe3c15379 req-1755eb05-9394-4b27-9e20-b6ab5b728e67 service nova] Creating event network-vif-deleted:42f071db-c04b-47df-ad6b-af38a1d48626 for instance 9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066 on hv-cinder-80473 Feb 16 14:29:38.951693 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-75d35741-66d4-4b80-b555-bc7fe3c15379 req-1755eb05-9394-4b27-9e20-b6ab5b728e67 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040126 Feb 16 14:29:38.963998 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 299/640] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:29:39.230564 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-d3a28f2a-cbeb-4fb3-bed7-28ab1eb05ada tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2fb466b-baef-4a6d-971e-eb681d05560e"}} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:29:39.232092 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-d3a28f2a-cbeb-4fb3-bed7-28ab1eb05ada tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f8777fc7-22f6-4dcf-885c-c08aa877b001] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:39.238705 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d3a28f2a-cbeb-4fb3-bed7-28ab1eb05ada tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:39.239443 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d3a28f2a-cbeb-4fb3-bed7-28ab1eb05ada tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:39.240518 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d3a28f2a-cbeb-4fb3-bed7-28ab1eb05ada tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:39.241463 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d3a28f2a-cbeb-4fb3-bed7-28ab1eb05ada tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:39.629590 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-854c7609-7065-4a83-8d27-65bcbd94bce3 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:39.630268 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-854c7609-7065-4a83-8d27-65bcbd94bce3 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] [instance: 9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:39.637565 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-854c7609-7065-4a83-8d27-65bcbd94bce3 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:39.638022 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-854c7609-7065-4a83-8d27-65bcbd94bce3 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:39.639646 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-854c7609-7065-4a83-8d27-65bcbd94bce3 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:39.639824 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-854c7609-7065-4a83-8d27-65bcbd94bce3 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:39.674522 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-854c7609-7065-4a83-8d27-65bcbd94bce3 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:39.675238 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-854c7609-7065-4a83-8d27-65bcbd94bce3 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:39.675977 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-854c7609-7065-4a83-8d27-65bcbd94bce3 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lazy-loading 'fault' on Instance uuid 9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066 {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:29:39.724155 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-854c7609-7065-4a83-8d27-65bcbd94bce3 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3770e2e31549417ea8b0f9055a128bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3600c4b4e2bf461f8716f080c94c58a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:39.733403 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-854c7609-7065-4a83-8d27-65bcbd94bce3 tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] 10.222.0.110 "GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066" status: 200 len: 1308 microversion: 2.1 time: 0.107752 Feb 16 14:29:39.734438 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 300/641] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:39 2022] GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066 => generated 1308 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:29:40.021927 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-d3a28f2a-cbeb-4fb3-bed7-28ab1eb05ada tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "POST /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.794764 Feb 16 14:29:40.023369 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 342/642] 10.222.0.110 () {60 vars in 1327 bytes} [Wed Feb 16 14:29:39 2022] POST /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001/os-volume_attachments => generated 194 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 14:29:40.751183 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b1ac56a9-6ec9-4655-a90e-28b6bced47ed tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:40.751795 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b1ac56a9-6ec9-4655-a90e-28b6bced47ed tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] [instance: 9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:40.758567 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b1ac56a9-6ec9-4655-a90e-28b6bced47ed tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:40.759221 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b1ac56a9-6ec9-4655-a90e-28b6bced47ed tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:40.760027 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b1ac56a9-6ec9-4655-a90e-28b6bced47ed tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:40.760468 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b1ac56a9-6ec9-4655-a90e-28b6bced47ed tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:40.774514 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-b1ac56a9-6ec9-4655-a90e-28b6bced47ed tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] HTTP exception thrown: Instance 9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066 could not be found. Feb 16 14:29:40.775163 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b1ac56a9-6ec9-4655-a90e-28b6bced47ed tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] Returning 404 to user: Instance 9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066 could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:29:40.776004 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b1ac56a9-6ec9-4655-a90e-28b6bced47ed tempest-VolumesNegativeTest-145466722 tempest-VolumesNegativeTest-145466722-project] 10.222.0.110 "GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066" status: 404 len: 111 microversion: 2.1 time: 0.028610 Feb 16 14:29:40.776557 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 301/643] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:40 2022] GET /compute/v2.1/servers/9bf28a36-4b4b-4e4c-b49d-d5b9ccaf7066 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Feb 16 14:29:48.940646 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-1b639a29-3390-49a6-a28b-875131979a86 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:48.941233 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-1b639a29-3390-49a6-a28b-875131979a86 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:48.948665 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1b639a29-3390-49a6-a28b-875131979a86 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:48.949391 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1b639a29-3390-49a6-a28b-875131979a86 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:48.950342 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1b639a29-3390-49a6-a28b-875131979a86 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:48.951166 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1b639a29-3390-49a6-a28b-875131979a86 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:48.987556 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-1b639a29-3390-49a6-a28b-875131979a86 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9/os-volume_attachments/0c5948b5-1967-4095-8b67-adf621809977" status: 200 len: 194 microversion: 2.20 time: 0.051559 Feb 16 14:29:48.988797 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 343/644] 10.222.0.110 () {60 vars in 1458 bytes} [Wed Feb 16 14:29:48 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9/os-volume_attachments/0c5948b5-1967-4095-8b67-adf621809977 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 16 14:29:49.063500 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-58e41804-1db2-468c-9457-6e9d979e7864 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:49.064583 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-58e41804-1db2-468c-9457-6e9d979e7864 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:49.072304 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-58e41804-1db2-468c-9457-6e9d979e7864 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:49.073147 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-58e41804-1db2-468c-9457-6e9d979e7864 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:49.074205 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-58e41804-1db2-468c-9457-6e9d979e7864 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:49.074915 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-58e41804-1db2-468c-9457-6e9d979e7864 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:49.207018 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-58e41804-1db2-468c-9457-6e9d979e7864 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lazy-loading 'services' on Instance uuid e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:29:49.468392 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-58e41804-1db2-468c-9457-6e9d979e7864 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "DELETE /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9/os-volume_attachments/0c5948b5-1967-4095-8b67-adf621809977" status: 202 len: 0 microversion: 2.20 time: 0.408516 Feb 16 14:29:49.474039 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 302/645] 10.222.0.110 () {60 vars in 1461 bytes} [Wed Feb 16 14:29:49 2022] DELETE /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9/os-volume_attachments/0c5948b5-1967-4095-8b67-adf621809977 => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 16 14:29:49.484015 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-0c9d69fb-3f1f-417e-8830-ba41cc3fb70d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:49.486000 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-0c9d69fb-3f1f-417e-8830-ba41cc3fb70d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:49.509360 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0c9d69fb-3f1f-417e-8830-ba41cc3fb70d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:49.509811 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0c9d69fb-3f1f-417e-8830-ba41cc3fb70d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:49.510614 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0c9d69fb-3f1f-417e-8830-ba41cc3fb70d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:49.511305 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0c9d69fb-3f1f-417e-8830-ba41cc3fb70d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:49.553551 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-0c9d69fb-3f1f-417e-8830-ba41cc3fb70d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076808 Feb 16 14:29:49.554462 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 344/646] 10.222.0.110 () {60 vars in 1347 bytes} [Wed Feb 16 14:29:49 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 16 14:29:50.552485 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-2d8d91a7-dd17-4b69-9a5d-72b71c3eee9a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1603491134", "imageRef": "2493d2dc-e081-43d3-8292-91b4762a21e8", "flavorRef": "452", "networks": [{"uuid": "36f39343-766a-4d7f-8597-906aa4ce6697"}]}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:29:50.569831 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-4f0aa1e1-f574-41a8-b82b-e1cc81974804 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:50.571043 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-4f0aa1e1-f574-41a8-b82b-e1cc81974804 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:50.583172 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4f0aa1e1-f574-41a8-b82b-e1cc81974804 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:50.583628 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4f0aa1e1-f574-41a8-b82b-e1cc81974804 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:50.584440 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4f0aa1e1-f574-41a8-b82b-e1cc81974804 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:50.584874 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4f0aa1e1-f574-41a8-b82b-e1cc81974804 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:50.621207 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-4f0aa1e1-f574-41a8-b82b-e1cc81974804 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057703 Feb 16 14:29:50.621827 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 345/647] 10.222.0.110 () {60 vars in 1347 bytes} [Wed Feb 16 14:29:50 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 16 14:29:51.632641 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-eafeff2b-4efb-415d-bcc6-8ce7d651aac5 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:51.633886 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-eafeff2b-4efb-415d-bcc6-8ce7d651aac5 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:51.641084 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-eafeff2b-4efb-415d-bcc6-8ce7d651aac5 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:51.641626 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-eafeff2b-4efb-415d-bcc6-8ce7d651aac5 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:51.642551 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-eafeff2b-4efb-415d-bcc6-8ce7d651aac5 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:51.643082 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-eafeff2b-4efb-415d-bcc6-8ce7d651aac5 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:51.680728 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-eafeff2b-4efb-415d-bcc6-8ce7d651aac5 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051962 Feb 16 14:29:51.681833 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 346/648] 10.222.0.110 () {60 vars in 1347 bytes} [Wed Feb 16 14:29:51 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 16 14:29:52.693430 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-fb88720e-a8eb-4a2b-b8d5-ced14f8d9f7d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:52.695030 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-fb88720e-a8eb-4a2b-b8d5-ced14f8d9f7d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:52.705373 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-fb88720e-a8eb-4a2b-b8d5-ced14f8d9f7d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:52.705834 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-fb88720e-a8eb-4a2b-b8d5-ced14f8d9f7d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:52.706662 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-fb88720e-a8eb-4a2b-b8d5-ced14f8d9f7d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:52.707271 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-fb88720e-a8eb-4a2b-b8d5-ced14f8d9f7d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:52.740512 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-fb88720e-a8eb-4a2b-b8d5-ced14f8d9f7d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052408 Feb 16 14:29:52.741089 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 347/649] 10.222.0.110 () {60 vars in 1347 bytes} [Wed Feb 16 14:29:52 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 16 14:29:53.752933 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-b301d32c-a522-4f5c-99e2-c3b6e1d86737 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:53.753840 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-b301d32c-a522-4f5c-99e2-c3b6e1d86737 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:53.760677 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b301d32c-a522-4f5c-99e2-c3b6e1d86737 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:53.761415 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b301d32c-a522-4f5c-99e2-c3b6e1d86737 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:53.762215 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b301d32c-a522-4f5c-99e2-c3b6e1d86737 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:53.762673 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b301d32c-a522-4f5c-99e2-c3b6e1d86737 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:53.811768 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-b301d32c-a522-4f5c-99e2-c3b6e1d86737 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061705 Feb 16 14:29:53.818948 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 348/650] 10.222.0.110 () {60 vars in 1347 bytes} [Wed Feb 16 14:29:53 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 16 14:29:54.771851 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.network.neutron [None req-2d8d91a7-dd17-4b69-9a5d-72b71c3eee9a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] validate_networks() for [('36f39343-766a-4d7f-8597-906aa4ce6697', None, None, None, None, None)] {{(pid=117032) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 16 14:29:54.832414 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-0c068b5f-dc1d-4b6f-9286-634acdcc9009 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:54.835978 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-0c068b5f-dc1d-4b6f-9286-634acdcc9009 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:54.848069 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0c068b5f-dc1d-4b6f-9286-634acdcc9009 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:54.848850 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0c068b5f-dc1d-4b6f-9286-634acdcc9009 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:54.850425 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0c068b5f-dc1d-4b6f-9286-634acdcc9009 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:54.851047 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0c068b5f-dc1d-4b6f-9286-634acdcc9009 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:54.896694 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-0c068b5f-dc1d-4b6f-9286-634acdcc9009 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.067894 Feb 16 14:29:54.905917 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 349/651] 10.222.0.110 () {60 vars in 1347 bytes} [Wed Feb 16 14:29:54 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:54.978671 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-4ab1daaf-2243-4828-b6f2-698cd81518ab tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:54.980611 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-4ab1daaf-2243-4828-b6f2-698cd81518ab tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:54.992719 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4ab1daaf-2243-4828-b6f2-698cd81518ab tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:54.993139 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4ab1daaf-2243-4828-b6f2-698cd81518ab tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:54.994021 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4ab1daaf-2243-4828-b6f2-698cd81518ab tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:54.994457 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4ab1daaf-2243-4828-b6f2-698cd81518ab tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:55.021759 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-4ab1daaf-2243-4828-b6f2-698cd81518ab tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Going to try to terminate instance {{(pid=117031) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 16 14:29:55.292495 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-2d8d91a7-dd17-4b69-9a5d-72b71c3eee9a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Flavor limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 16 14:29:55.292495 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-2d8d91a7-dd17-4b69-9a5d-72b71c3eee9a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Image limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 16 14:29:55.292495 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-2d8d91a7-dd17-4b69-9a5d-72b71c3eee9a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Flavor pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 16 14:29:55.292495 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-2d8d91a7-dd17-4b69-9a5d-72b71c3eee9a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Image pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 16 14:29:55.292495 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-2d8d91a7-dd17-4b69-9a5d-72b71c3eee9a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 16 14:29:55.293005 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2d8d91a7-dd17-4b69-9a5d-72b71c3eee9a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:55.293005 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2d8d91a7-dd17-4b69-9a5d-72b71c3eee9a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:55.293005 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2d8d91a7-dd17-4b69-9a5d-72b71c3eee9a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:55.293005 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2d8d91a7-dd17-4b69-9a5d-72b71c3eee9a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:55.293389 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-2d8d91a7-dd17-4b69-9a5d-72b71c3eee9a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Getting quotas for project f334385dc44348ac9942c6606482330e. Resources: {'cores', 'instances', 'ram'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 14:29:55.295656 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-2d8d91a7-dd17-4b69-9a5d-72b71c3eee9a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Getting quotas for user cd0569c12f1740b9a4fab4e6a15f25ed and project f334385dc44348ac9942c6606482330e. Resources: {'cores', 'instances', 'ram'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 14:29:55.307463 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-2d8d91a7-dd17-4b69-9a5d-72b71c3eee9a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Going to run 1 instances... {{(pid=117032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 16 14:29:55.310094 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-2d8d91a7-dd17-4b69-9a5d-72b71c3eee9a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: 0185f443-9306-4933-b44f-814c65b3c0b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2493d2dc-e081-43d3-8292-91b4762a21e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 16 14:29:55.643410 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-4ab1daaf-2243-4828-b6f2-698cd81518ab tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "DELETE /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 204 len: 0 microversion: 2.20 time: 0.670817 Feb 16 14:29:55.645507 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 350/652] 10.222.0.110 () {60 vars in 1284 bytes} [Wed Feb 16 14:29:54 2022] DELETE /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 16 14:29:55.654943 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-df1dfacd-ead2-487a-85b2-f49aac8e6eb0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:55.655649 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-df1dfacd-ead2-487a-85b2-f49aac8e6eb0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:55.659900 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-2d8d91a7-dd17-4b69-9a5d-72b71c3eee9a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 5.112176 Feb 16 14:29:55.666729 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 303/653] 10.222.0.110 () {60 vars in 1151 bytes} [Wed Feb 16 14:29:50 2022] POST /compute/v2.1/servers => generated 382 bytes in 5114 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Feb 16 14:29:55.666939 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-df1dfacd-ead2-487a-85b2-f49aac8e6eb0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:55.666939 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-df1dfacd-ead2-487a-85b2-f49aac8e6eb0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:55.666939 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-df1dfacd-ead2-487a-85b2-f49aac8e6eb0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:55.666939 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-df1dfacd-ead2-487a-85b2-f49aac8e6eb0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:55.671557 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-2c16eba5-2237-46b6-bcc1-c8785ea3863f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:55.672239 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-2c16eba5-2237-46b6-bcc1-c8785ea3863f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: 0185f443-9306-4933-b44f-814c65b3c0b9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:55.740256 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-2c16eba5-2237-46b6-bcc1-c8785ea3863f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:55.751403 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-2c16eba5-2237-46b6-bcc1-c8785ea3863f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9" status: 200 len: 1222 microversion: 2.1 time: 0.083593 Feb 16 14:29:55.756216 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 304/654] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:55 2022] GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:29:55.834215 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-df1dfacd-ead2-487a-85b2-f49aac8e6eb0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:55.843028 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-df1dfacd-ead2-487a-85b2-f49aac8e6eb0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:55.844660 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-df1dfacd-ead2-487a-85b2-f49aac8e6eb0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:55.845906 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-df1dfacd-ead2-487a-85b2-f49aac8e6eb0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1727 microversion: 2.20 time: 0.194989 Feb 16 14:29:55.847440 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 351/655] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:29:55 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1727 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:29:56.767796 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-fa2f4f44-47f8-4540-85f0-e8421ae7c3f6 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:56.768986 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-fa2f4f44-47f8-4540-85f0-e8421ae7c3f6 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: 0185f443-9306-4933-b44f-814c65b3c0b9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:56.777811 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fa2f4f44-47f8-4540-85f0-e8421ae7c3f6 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:56.778268 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fa2f4f44-47f8-4540-85f0-e8421ae7c3f6 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:56.779102 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fa2f4f44-47f8-4540-85f0-e8421ae7c3f6 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:56.779566 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fa2f4f44-47f8-4540-85f0-e8421ae7c3f6 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:56.859536 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-fa2f4f44-47f8-4540-85f0-e8421ae7c3f6 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:56.864519 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-5e7216f4-7f4e-4f52-82c0-ba68173f577e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:56.865267 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-5e7216f4-7f4e-4f52-82c0-ba68173f577e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:56.872405 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-fa2f4f44-47f8-4540-85f0-e8421ae7c3f6 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9" status: 200 len: 1226 microversion: 2.1 time: 0.108189 Feb 16 14:29:56.872698 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5e7216f4-7f4e-4f52-82c0-ba68173f577e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:56.873521 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 305/656] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:56 2022] GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9 => generated 1226 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:29:56.896582 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5e7216f4-7f4e-4f52-82c0-ba68173f577e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:56.897959 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5e7216f4-7f4e-4f52-82c0-ba68173f577e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:56.898748 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5e7216f4-7f4e-4f52-82c0-ba68173f577e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:57.075780 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-5e7216f4-7f4e-4f52-82c0-ba68173f577e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:57.092210 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-5e7216f4-7f4e-4f52-82c0-ba68173f577e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:57.094256 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-5e7216f4-7f4e-4f52-82c0-ba68173f577e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:57.095737 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-5e7216f4-7f4e-4f52-82c0-ba68173f577e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1727 microversion: 2.20 time: 0.235191 Feb 16 14:29:57.108031 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 352/657] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:29:56 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1727 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:29:57.875889 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-1252da81-0f6c-4fd3-9938-d9b68a10fdf0 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:57.876996 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-1252da81-0f6c-4fd3-9938-d9b68a10fdf0 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: 7a7441d1-fed1-484d-8802-a1ef5e016198] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:57.883983 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1252da81-0f6c-4fd3-9938-d9b68a10fdf0 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:57.884448 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1252da81-0f6c-4fd3-9938-d9b68a10fdf0 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:57.885494 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1252da81-0f6c-4fd3-9938-d9b68a10fdf0 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:57.886094 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1252da81-0f6c-4fd3-9938-d9b68a10fdf0 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:57.889571 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-8d7d4363-76ed-414b-9f30-588b27e4490b tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:57.893808 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-8d7d4363-76ed-414b-9f30-588b27e4490b tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: 0185f443-9306-4933-b44f-814c65b3c0b9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:57.901741 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8d7d4363-76ed-414b-9f30-588b27e4490b tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:57.902663 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8d7d4363-76ed-414b-9f30-588b27e4490b tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:57.903837 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8d7d4363-76ed-414b-9f30-588b27e4490b tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:57.904508 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8d7d4363-76ed-414b-9f30-588b27e4490b tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:57.977519 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-1252da81-0f6c-4fd3-9938-d9b68a10fdf0 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lazy-loading 'services' on Instance uuid 7a7441d1-fed1-484d-8802-a1ef5e016198 {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:29:57.984021 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-8d7d4363-76ed-414b-9f30-588b27e4490b tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:57.996095 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-8d7d4363-76ed-414b-9f30-588b27e4490b tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9" status: 200 len: 1274 microversion: 2.1 time: 0.107376 Feb 16 14:29:57.998785 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 353/658] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:57 2022] GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9 => generated 1274 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:29:58.113584 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-5cb32d6a-2fe6-400c-9a48-c85787705480 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:58.114186 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-5cb32d6a-2fe6-400c-9a48-c85787705480 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:58.122950 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5cb32d6a-2fe6-400c-9a48-c85787705480 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:58.123727 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5cb32d6a-2fe6-400c-9a48-c85787705480 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:58.125404 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5cb32d6a-2fe6-400c-9a48-c85787705480 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:58.125946 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5cb32d6a-2fe6-400c-9a48-c85787705480 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:58.231656 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-1252da81-0f6c-4fd3-9938-d9b68a10fdf0 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "DELETE /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198/os-volume_attachments/dbd4104f-94be-427b-b796-47d023155042" status: 202 len: 0 microversion: 2.1 time: 0.360708 Feb 16 14:29:58.245392 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 306/659] 10.222.0.110 () {58 vars in 1420 bytes} [Wed Feb 16 14:29:57 2022] DELETE /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198/os-volume_attachments/dbd4104f-94be-427b-b796-47d023155042 => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 14:29:58.307916 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-5cb32d6a-2fe6-400c-9a48-c85787705480 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:58.323375 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-5cb32d6a-2fe6-400c-9a48-c85787705480 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:58.323375 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-5cb32d6a-2fe6-400c-9a48-c85787705480 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:58.323375 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-5cb32d6a-2fe6-400c-9a48-c85787705480 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1727 microversion: 2.20 time: 0.209435 Feb 16 14:29:58.323723 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 354/660] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:29:58 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1727 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:29:59.023389 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-3a154755-8b9d-46a4-a9bc-42214b70ab04 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:59.024450 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-3a154755-8b9d-46a4-a9bc-42214b70ab04 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: 0185f443-9306-4933-b44f-814c65b3c0b9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:59.032394 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3a154755-8b9d-46a4-a9bc-42214b70ab04 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:59.033252 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3a154755-8b9d-46a4-a9bc-42214b70ab04 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:59.034157 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3a154755-8b9d-46a4-a9bc-42214b70ab04 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:59.034740 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3a154755-8b9d-46a4-a9bc-42214b70ab04 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:59.339872 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-a43d872f-ba66-4f1e-bb64-c6eb43ca0ecc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:29:59.340938 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-a43d872f-ba66-4f1e-bb64-c6eb43ca0ecc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:29:59.349980 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a43d872f-ba66-4f1e-bb64-c6eb43ca0ecc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:59.353363 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a43d872f-ba66-4f1e-bb64-c6eb43ca0ecc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:59.355053 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a43d872f-ba66-4f1e-bb64-c6eb43ca0ecc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:29:59.356192 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a43d872f-ba66-4f1e-bb64-c6eb43ca0ecc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:29:59.366745 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3a154755-8b9d-46a4-a9bc-42214b70ab04 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:59.374746 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-3a154755-8b9d-46a4-a9bc-42214b70ab04 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9" status: 200 len: 1280 microversion: 2.1 time: 0.356952 Feb 16 14:29:59.375330 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 307/661] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:29:59 2022] GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9 => generated 1280 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:29:59.505843 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-a43d872f-ba66-4f1e-bb64-c6eb43ca0ecc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:59.516612 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-a43d872f-ba66-4f1e-bb64-c6eb43ca0ecc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:59.518358 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-a43d872f-ba66-4f1e-bb64-c6eb43ca0ecc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:29:59.520486 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-a43d872f-ba66-4f1e-bb64-c6eb43ca0ecc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1727 microversion: 2.20 time: 0.185429 Feb 16 14:29:59.521193 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 355/662] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:29:59 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1727 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:29:59.753260 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-57eb6a3b-423e-4369-b27d-8aab00574a69 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Action: 'create', calling method: .version_select at 0x7f2990e611f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2072384014"}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:29:59.767479 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-57eb6a3b-423e-4369-b27d-8aab00574a69 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Getting quotas for project 65654470458446859230c6803abfa3ba. Resources: {'key_pairs'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 14:29:59.771299 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-57eb6a3b-423e-4369-b27d-8aab00574a69 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Getting quotas for user f4876916bb0948a6ada6c5202a01d466 and project 65654470458446859230c6803abfa3ba. Resources: {'key_pairs'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 14:30:00.236460 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-57eb6a3b-423e-4369-b27d-8aab00574a69 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Getting quotas for project 65654470458446859230c6803abfa3ba. Resources: {'key_pairs'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 14:30:00.241634 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-57eb6a3b-423e-4369-b27d-8aab00574a69 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Getting quotas for user f4876916bb0948a6ada6c5202a01d466 and project 65654470458446859230c6803abfa3ba. Resources: {'key_pairs'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 14:30:00.257083 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-57eb6a3b-423e-4369-b27d-8aab00574a69 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.508167 Feb 16 14:30:00.258701 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 308/663] 10.222.0.110 () {60 vars in 1162 bytes} [Wed Feb 16 14:29:59 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:30:00.306762 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-454c277e-96b2-4cf2-a0a4-c17c4ed81c34 req-e9d8ef78-932f-4d98-8299-5e81607c7cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2139817-3f2e-4e56-87d6-a56a2ca2f6f9", "name": "network-vif-deleted", "tag": "e636434b-73f6-458a-9681-a71516b2260d"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:30:00.308421 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:30:00.308421 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:30:00.315340 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-454c277e-96b2-4cf2-a0a4-c17c4ed81c34 req-e9d8ef78-932f-4d98-8299-5e81607c7cd4 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:00.315954 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-454c277e-96b2-4cf2-a0a4-c17c4ed81c34 req-e9d8ef78-932f-4d98-8299-5e81607c7cd4 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:00.328329 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-454c277e-96b2-4cf2-a0a4-c17c4ed81c34 req-e9d8ef78-932f-4d98-8299-5e81607c7cd4 service nova] Creating event network-vif-deleted:e636434b-73f6-458a-9681-a71516b2260d for instance e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 on hv-cinder-80473 Feb 16 14:30:00.333690 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-454c277e-96b2-4cf2-a0a4-c17c4ed81c34 req-e9d8ef78-932f-4d98-8299-5e81607c7cd4 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032039 Feb 16 14:30:00.334286 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 356/664] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:30:00.375041 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-d3e70a5d-71ca-453d-a24a-aff3510b418b tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-907971249", "imageRef": "9b93d0d7-4881-4d62-9225-52a3db753c77", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2072384014", "networks": [{"uuid": "3fadbba7-e16d-46dc-a1db-5ba2b73129f3"}]}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:30:00.393124 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-6ccf00d1-6b48-45bd-b612-aa2fd32a58ab tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:00.393831 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-6ccf00d1-6b48-45bd-b612-aa2fd32a58ab tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: 0185f443-9306-4933-b44f-814c65b3c0b9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:00.405350 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-6ccf00d1-6b48-45bd-b612-aa2fd32a58ab tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:00.405350 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-6ccf00d1-6b48-45bd-b612-aa2fd32a58ab tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:00.405350 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-6ccf00d1-6b48-45bd-b612-aa2fd32a58ab tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:00.405350 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-6ccf00d1-6b48-45bd-b612-aa2fd32a58ab tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:00.469575 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.network.neutron [None req-d3e70a5d-71ca-453d-a24a-aff3510b418b tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] validate_networks() for [('3fadbba7-e16d-46dc-a1db-5ba2b73129f3', None, None, None, None, None)] {{(pid=117032) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 16 14:30:00.632022 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-6ccf00d1-6b48-45bd-b612-aa2fd32a58ab tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:00.650477 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-6ccf00d1-6b48-45bd-b612-aa2fd32a58ab tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9" status: 200 len: 1322 microversion: 2.1 time: 0.261796 Feb 16 14:30:00.651778 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 357/665] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:00 2022] GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9 => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:30:00.656734 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-bc399b11-866e-4fc9-bfa2-d7fe34d705a3 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:00.657723 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-bc399b11-866e-4fc9-bfa2-d7fe34d705a3 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: 7a7441d1-fed1-484d-8802-a1ef5e016198] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:00.665580 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-bc399b11-866e-4fc9-bfa2-d7fe34d705a3 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:00.666235 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-bc399b11-866e-4fc9-bfa2-d7fe34d705a3 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:00.667274 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-bc399b11-866e-4fc9-bfa2-d7fe34d705a3 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:00.668112 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-bc399b11-866e-4fc9-bfa2-d7fe34d705a3 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:00.696551 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-bc399b11-866e-4fc9-bfa2-d7fe34d705a3 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: 7a7441d1-fed1-484d-8802-a1ef5e016198] Going to try to terminate instance {{(pid=117031) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 16 14:30:00.963771 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-bc399b11-866e-4fc9-bfa2-d7fe34d705a3 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "DELETE /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198" status: 204 len: 0 microversion: 2.1 time: 0.310569 Feb 16 14:30:00.964840 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 358/666] 10.222.0.110 () {58 vars in 1243 bytes} [Wed Feb 16 14:30:00 2022] DELETE /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 16 14:30:00.970592 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-bea9e36b-0433-4bd6-aced-0e8e587c503b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:00.976247 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-bea9e36b-0433-4bd6-aced-0e8e587c503b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:00.983748 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-bea9e36b-0433-4bd6-aced-0e8e587c503b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:00.984410 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-bea9e36b-0433-4bd6-aced-0e8e587c503b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:00.985377 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-bea9e36b-0433-4bd6-aced-0e8e587c503b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:00.985979 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-bea9e36b-0433-4bd6-aced-0e8e587c503b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:01.019082 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-bea9e36b-0433-4bd6-aced-0e8e587c503b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:01.019807 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-bea9e36b-0433-4bd6-aced-0e8e587c503b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:01.020412 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.objects.instance [None req-bea9e36b-0433-4bd6-aced-0e8e587c503b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lazy-loading 'fault' on Instance uuid e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 {{(pid=117031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:30:01.065630 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-bea9e36b-0433-4bd6-aced-0e8e587c503b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:01.077372 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-bea9e36b-0433-4bd6-aced-0e8e587c503b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:01.079512 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-bea9e36b-0433-4bd6-aced-0e8e587c503b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:01.081140 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-bea9e36b-0433-4bd6-aced-0e8e587c503b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 200 len: 1374 microversion: 2.20 time: 0.114833 Feb 16 14:30:01.082161 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 359/667] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:30:00 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 1374 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:30:01.087719 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-7294087b-c438-44d5-9b68-6fe3341a4618 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:01.088570 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-7294087b-c438-44d5-9b68-6fe3341a4618 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: 7a7441d1-fed1-484d-8802-a1ef5e016198] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:01.095368 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7294087b-c438-44d5-9b68-6fe3341a4618 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:01.096050 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7294087b-c438-44d5-9b68-6fe3341a4618 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:01.097161 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7294087b-c438-44d5-9b68-6fe3341a4618 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:01.098144 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7294087b-c438-44d5-9b68-6fe3341a4618 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:01.280598 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-7294087b-c438-44d5-9b68-6fe3341a4618 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:01.290719 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-7294087b-c438-44d5-9b68-6fe3341a4618 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198" status: 200 len: 1518 microversion: 2.1 time: 0.207153 Feb 16 14:30:01.291836 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 360/668] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:01 2022] GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198 => generated 1518 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:01.332477 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-d3e70a5d-71ca-453d-a24a-aff3510b418b tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Flavor limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 16 14:30:01.333707 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-d3e70a5d-71ca-453d-a24a-aff3510b418b tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Image limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 16 14:30:01.334230 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-d3e70a5d-71ca-453d-a24a-aff3510b418b tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Flavor pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 16 14:30:01.334663 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-d3e70a5d-71ca-453d-a24a-aff3510b418b tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Image pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 16 14:30:01.335091 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-d3e70a5d-71ca-453d-a24a-aff3510b418b tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 16 14:30:01.347534 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d3e70a5d-71ca-453d-a24a-aff3510b418b tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:01.348286 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d3e70a5d-71ca-453d-a24a-aff3510b418b tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:01.349294 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d3e70a5d-71ca-453d-a24a-aff3510b418b tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:01.349739 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d3e70a5d-71ca-453d-a24a-aff3510b418b tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:01.372749 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-d3e70a5d-71ca-453d-a24a-aff3510b418b tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Getting quotas for project 65654470458446859230c6803abfa3ba. Resources: {'cores', 'instances', 'ram'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 14:30:01.377162 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-d3e70a5d-71ca-453d-a24a-aff3510b418b tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Getting quotas for user f4876916bb0948a6ada6c5202a01d466 and project 65654470458446859230c6803abfa3ba. Resources: {'cores', 'instances', 'ram'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 14:30:01.389565 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-d3e70a5d-71ca-453d-a24a-aff3510b418b tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Going to run 1 instances... {{(pid=117032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 16 14:30:01.392467 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-d3e70a5d-71ca-453d-a24a-aff3510b418b tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9b93d0d7-4881-4d62-9225-52a3db753c77',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 16 14:30:01.582488 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-d3e70a5d-71ca-453d-a24a-aff3510b418b tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.211267 Feb 16 14:30:01.583168 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 309/669] 10.222.0.110 () {60 vars in 1151 bytes} [Wed Feb 16 14:30:00 2022] POST /compute/v2.1/servers => generated 382 bytes in 1213 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Feb 16 14:30:01.594356 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-cf0aa6ff-0dcb-4c69-ba86-cb83b086734c tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:01.595149 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-cf0aa6ff-0dcb-4c69-ba86-cb83b086734c tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:01.673542 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-1b689806-8e1c-490d-b62e-9f5f9ef9c37e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:01.674220 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-1b689806-8e1c-490d-b62e-9f5f9ef9c37e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: 0185f443-9306-4933-b44f-814c65b3c0b9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:01.680615 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-cf0aa6ff-0dcb-4c69-ba86-cb83b086734c tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:01.693123 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1b689806-8e1c-490d-b62e-9f5f9ef9c37e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:01.693442 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1b689806-8e1c-490d-b62e-9f5f9ef9c37e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:01.698476 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-cf0aa6ff-0dcb-4c69-ba86-cb83b086734c tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1262 microversion: 2.1 time: 0.107728 Feb 16 14:30:01.715131 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 361/670] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:01 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1262 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:01.717168 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1b689806-8e1c-490d-b62e-9f5f9ef9c37e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:01.717866 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1b689806-8e1c-490d-b62e-9f5f9ef9c37e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:01.972541 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-1b689806-8e1c-490d-b62e-9f5f9ef9c37e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:01.982156 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-1b689806-8e1c-490d-b62e-9f5f9ef9c37e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9" status: 200 len: 1322 microversion: 2.1 time: 0.312595 Feb 16 14:30:01.983183 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 310/671] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:01 2022] GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9 => generated 1322 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:02.104416 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-4713721e-1cf0-4b2e-80f3-369acf8319a1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:02.105029 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-4713721e-1cf0-4b2e-80f3-369acf8319a1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:02.112075 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4713721e-1cf0-4b2e-80f3-369acf8319a1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:02.116049 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4713721e-1cf0-4b2e-80f3-369acf8319a1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:02.116049 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4713721e-1cf0-4b2e-80f3-369acf8319a1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:02.116049 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4713721e-1cf0-4b2e-80f3-369acf8319a1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:02.134119 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.wsgi [None req-4713721e-1cf0-4b2e-80f3-369acf8319a1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] HTTP exception thrown: Instance e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 could not be found. Feb 16 14:30:02.135316 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-4713721e-1cf0-4b2e-80f3-369acf8319a1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Returning 404 to user: Instance e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 could not be found. {{(pid=117031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:30:02.135694 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-4713721e-1cf0-4b2e-80f3-369acf8319a1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 404 len: 111 microversion: 2.20 time: 0.036024 Feb 16 14:30:02.139535 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 362/672] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:30:02 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 16 14:30:02.144858 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-bb430c62-8b1f-452c-a919-1c3b359ce2db tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '.version_select at 0x7f2990dfaaf0>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:02.238684 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-bb430c62-8b1f-452c-a919-1c3b359ce2db tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-50919512" status: 204 len: 0 microversion: 2.20 time: 0.097501 Feb 16 14:30:02.239548 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 311/673] 10.222.0.110 () {60 vars in 1260 bytes} [Wed Feb 16 14:30:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-50919512 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 16 14:30:02.312963 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-7b9eb6fa-5f9a-4d88-889e-d0b064456f41 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:02.314409 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-7b9eb6fa-5f9a-4d88-889e-d0b064456f41 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: 7a7441d1-fed1-484d-8802-a1ef5e016198] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:02.328421 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7b9eb6fa-5f9a-4d88-889e-d0b064456f41 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:02.329114 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7b9eb6fa-5f9a-4d88-889e-d0b064456f41 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:02.331371 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7b9eb6fa-5f9a-4d88-889e-d0b064456f41 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:02.332014 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7b9eb6fa-5f9a-4d88-889e-d0b064456f41 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:02.370437 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-fd89c706-6cf3-4bce-8a05-f2ee52d54cbd req-13a1dd03-2097-4bb4-b7c4-6ed26362df98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0185f443-9306-4933-b44f-814c65b3c0b9", "tag": "f45e1896-cbac-4079-bf31-95878784e9ba"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:30:02.372361 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:30:02.372361 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: warnings.warn(msg) Feb 16 14:30:02.385180 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-fd89c706-6cf3-4bce-8a05-f2ee52d54cbd req-13a1dd03-2097-4bb4-b7c4-6ed26362df98 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:02.385764 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-fd89c706-6cf3-4bce-8a05-f2ee52d54cbd req-13a1dd03-2097-4bb4-b7c4-6ed26362df98 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:02.396620 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-fd89c706-6cf3-4bce-8a05-f2ee52d54cbd req-13a1dd03-2097-4bb4-b7c4-6ed26362df98 service nova] Creating event network-changed:f45e1896-cbac-4079-bf31-95878784e9ba for instance 0185f443-9306-4933-b44f-814c65b3c0b9 on hv-cinder-80473 Feb 16 14:30:02.402474 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-fd89c706-6cf3-4bce-8a05-f2ee52d54cbd req-13a1dd03-2097-4bb4-b7c4-6ed26362df98 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036520 Feb 16 14:30:02.403279 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 312/674] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:30:02.530454 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-7b9eb6fa-5f9a-4d88-889e-d0b064456f41 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:02.564164 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-7b9eb6fa-5f9a-4d88-889e-d0b064456f41 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198" status: 200 len: 1518 microversion: 2.1 time: 0.259361 Feb 16 14:30:02.571329 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 363/675] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:02 2022] GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198 => generated 1518 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:02.716431 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c18a14af-2c44-4ea3-9701-7373cf888f3e tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:02.717022 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c18a14af-2c44-4ea3-9701-7373cf888f3e tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:02.790239 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c18a14af-2c44-4ea3-9701-7373cf888f3e tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:02.797137 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c18a14af-2c44-4ea3-9701-7373cf888f3e tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1262 microversion: 2.1 time: 0.084772 Feb 16 14:30:02.798097 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 313/676] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:02 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:30:02.999487 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-ea93b1e6-70b8-40e0-9e3c-0e3aa5541023 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:03.000250 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-ea93b1e6-70b8-40e0-9e3c-0e3aa5541023 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: 0185f443-9306-4933-b44f-814c65b3c0b9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:03.006935 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ea93b1e6-70b8-40e0-9e3c-0e3aa5541023 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:03.007471 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ea93b1e6-70b8-40e0-9e3c-0e3aa5541023 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:03.008590 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ea93b1e6-70b8-40e0-9e3c-0e3aa5541023 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:03.009193 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ea93b1e6-70b8-40e0-9e3c-0e3aa5541023 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:03.260325 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f54d4f9b-5665-4d08-8027-15a8ebcaa933 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Action: 'create', calling method: .version_select at 0x7f2990eb89d0>, body: {"keypair": {"name": "tempest-keypair-941938357"}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:30:03.261587 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-ea93b1e6-70b8-40e0-9e3c-0e3aa5541023 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:03.271977 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-ea93b1e6-70b8-40e0-9e3c-0e3aa5541023 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9" status: 200 len: 1322 microversion: 2.1 time: 0.277339 Feb 16 14:30:03.274955 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 364/677] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:02 2022] GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9 => generated 1322 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:03.291486 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-f54d4f9b-5665-4d08-8027-15a8ebcaa933 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Getting quotas for project aeb2105b246e4f78bccf81a39b007f69. Resources: {'key_pairs'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 14:30:03.296051 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-f54d4f9b-5665-4d08-8027-15a8ebcaa933 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Getting quotas for user 745ca4a19a674037b9fee7f3778c05eb and project aeb2105b246e4f78bccf81a39b007f69. Resources: {'key_pairs'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 14:30:03.576969 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-f54d4f9b-5665-4d08-8027-15a8ebcaa933 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Getting quotas for project aeb2105b246e4f78bccf81a39b007f69. Resources: {'key_pairs'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 14:30:03.587252 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-7cb942ed-d631-4565-aa9b-3bda941f81d4 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:03.587559 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-f54d4f9b-5665-4d08-8027-15a8ebcaa933 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Getting quotas for user 745ca4a19a674037b9fee7f3778c05eb and project aeb2105b246e4f78bccf81a39b007f69. Resources: {'key_pairs'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 14:30:03.588535 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-7cb942ed-d631-4565-aa9b-3bda941f81d4 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: 7a7441d1-fed1-484d-8802-a1ef5e016198] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:03.599486 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7cb942ed-d631-4565-aa9b-3bda941f81d4 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:03.600086 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7cb942ed-d631-4565-aa9b-3bda941f81d4 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:03.601115 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7cb942ed-d631-4565-aa9b-3bda941f81d4 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:03.601780 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7cb942ed-d631-4565-aa9b-3bda941f81d4 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:03.605562 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f54d4f9b-5665-4d08-8027-15a8ebcaa933 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.350281 Feb 16 14:30:03.607068 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 314/678] 10.222.0.110 () {62 vars in 1203 bytes} [Wed Feb 16 14:30:03 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 352 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Feb 16 14:30:03.816848 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-d1a41a3c-346e-4980-90c9-c3ce49c6b5e1 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:03.817695 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-d1a41a3c-346e-4980-90c9-c3ce49c6b5e1 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:03.831922 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d1a41a3c-346e-4980-90c9-c3ce49c6b5e1 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:03.832390 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d1a41a3c-346e-4980-90c9-c3ce49c6b5e1 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:03.832846 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-7cb942ed-d631-4565-aa9b-3bda941f81d4 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:03.837769 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d1a41a3c-346e-4980-90c9-c3ce49c6b5e1 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:03.838322 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d1a41a3c-346e-4980-90c9-c3ce49c6b5e1 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:03.841974 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-7cb942ed-d631-4565-aa9b-3bda941f81d4 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198" status: 200 len: 1518 microversion: 2.1 time: 0.260119 Feb 16 14:30:03.845511 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 365/679] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:03 2022] GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198 => generated 1518 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:30:03.917518 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d1a41a3c-346e-4980-90c9-c3ce49c6b5e1 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:03.924947 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-d1a41a3c-346e-4980-90c9-c3ce49c6b5e1 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1314 microversion: 2.1 time: 0.113183 Feb 16 14:30:03.926221 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 315/680] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:03 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1314 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:04.293529 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-1610fbfb-0ad7-4908-a362-cf2f47b0bae4 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:04.294151 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-1610fbfb-0ad7-4908-a362-cf2f47b0bae4 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: 0185f443-9306-4933-b44f-814c65b3c0b9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:04.307342 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1610fbfb-0ad7-4908-a362-cf2f47b0bae4 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:04.307796 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1610fbfb-0ad7-4908-a362-cf2f47b0bae4 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:04.308626 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1610fbfb-0ad7-4908-a362-cf2f47b0bae4 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:04.309156 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1610fbfb-0ad7-4908-a362-cf2f47b0bae4 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:04.426792 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-75c3b335-d5a6-44d3-879c-0ba65d2e8c94 req-8d0ed8c9-81cb-48d8-aef5-f8db788dde33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a7441d1-fed1-484d-8802-a1ef5e016198", "name": "network-vif-deleted", "tag": "1fb6bfc4-5c28-4aa7-afef-dea28a833f1c"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:30:04.429065 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:30:04.429065 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: warnings.warn(msg) Feb 16 14:30:04.442533 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-75c3b335-d5a6-44d3-879c-0ba65d2e8c94 req-8d0ed8c9-81cb-48d8-aef5-f8db788dde33 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:04.443201 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-75c3b335-d5a6-44d3-879c-0ba65d2e8c94 req-8d0ed8c9-81cb-48d8-aef5-f8db788dde33 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:04.463612 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-75c3b335-d5a6-44d3-879c-0ba65d2e8c94 req-8d0ed8c9-81cb-48d8-aef5-f8db788dde33 service nova] Creating event network-vif-deleted:1fb6bfc4-5c28-4aa7-afef-dea28a833f1c for instance 7a7441d1-fed1-484d-8802-a1ef5e016198 on hv-cinder-80473 Feb 16 14:30:04.494798 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-75c3b335-d5a6-44d3-879c-0ba65d2e8c94 req-8d0ed8c9-81cb-48d8-aef5-f8db788dde33 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072142 Feb 16 14:30:04.495818 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 316/681] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:30:04.535450 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-1610fbfb-0ad7-4908-a362-cf2f47b0bae4 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:04.544219 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-1610fbfb-0ad7-4908-a362-cf2f47b0bae4 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9" status: 200 len: 1322 microversion: 2.1 time: 0.255138 Feb 16 14:30:04.552877 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 366/682] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:04 2022] GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9 => generated 1322 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:04.861894 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-1130b6dd-feff-42ed-b73b-c5f433171a34 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:04.869574 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-1130b6dd-feff-42ed-b73b-c5f433171a34 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: 7a7441d1-fed1-484d-8802-a1ef5e016198] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:04.875332 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1130b6dd-feff-42ed-b73b-c5f433171a34 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:04.876757 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1130b6dd-feff-42ed-b73b-c5f433171a34 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:04.879892 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1130b6dd-feff-42ed-b73b-c5f433171a34 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:04.880458 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1130b6dd-feff-42ed-b73b-c5f433171a34 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:04.921514 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1130b6dd-feff-42ed-b73b-c5f433171a34 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:04.922089 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1130b6dd-feff-42ed-b73b-c5f433171a34 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:04.923157 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-1130b6dd-feff-42ed-b73b-c5f433171a34 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lazy-loading 'fault' on Instance uuid 7a7441d1-fed1-484d-8802-a1ef5e016198 {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:30:04.942355 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-7914b45a-043b-43ab-a7d6-aa0fc3841e74 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:04.943545 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-7914b45a-043b-43ab-a7d6-aa0fc3841e74 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:04.950554 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7914b45a-043b-43ab-a7d6-aa0fc3841e74 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:04.951236 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7914b45a-043b-43ab-a7d6-aa0fc3841e74 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:04.955672 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7914b45a-043b-43ab-a7d6-aa0fc3841e74 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:04.955672 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7914b45a-043b-43ab-a7d6-aa0fc3841e74 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:04.976099 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-1130b6dd-feff-42ed-b73b-c5f433171a34 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '607d12050d20401e9850ab64c57b8c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c24eb6d16648b4a04462f208612157', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:04.985134 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-1130b6dd-feff-42ed-b73b-c5f433171a34 tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198" status: 200 len: 1312 microversion: 2.1 time: 0.127525 Feb 16 14:30:04.987647 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 317/683] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:04 2022] GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198 => generated 1312 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:05.038453 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-7914b45a-043b-43ab-a7d6-aa0fc3841e74 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:05.049109 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-7914b45a-043b-43ab-a7d6-aa0fc3841e74 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1320 microversion: 2.1 time: 0.110161 Feb 16 14:30:05.060065 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 367/684] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:04 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1320 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:30:05.562284 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-8428dd38-000c-4524-a404-c627a251a6ae tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:05.563017 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-8428dd38-000c-4524-a404-c627a251a6ae tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: 0185f443-9306-4933-b44f-814c65b3c0b9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:05.573628 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8428dd38-000c-4524-a404-c627a251a6ae tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:05.574080 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8428dd38-000c-4524-a404-c627a251a6ae tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:05.574893 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8428dd38-000c-4524-a404-c627a251a6ae tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:05.575328 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8428dd38-000c-4524-a404-c627a251a6ae tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:05.891922 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-8428dd38-000c-4524-a404-c627a251a6ae tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:05.900054 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-8428dd38-000c-4524-a404-c627a251a6ae tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9" status: 200 len: 1322 microversion: 2.1 time: 0.342963 Feb 16 14:30:05.910038 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 318/685] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:05 2022] GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9 => generated 1322 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:06.006495 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-ddc7d4f4-4ea7-4207-ae09-1c524c05ac5a tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:06.010096 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-ddc7d4f4-4ea7-4207-ae09-1c524c05ac5a tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] [instance: 7a7441d1-fed1-484d-8802-a1ef5e016198] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:06.023797 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ddc7d4f4-4ea7-4207-ae09-1c524c05ac5a tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:06.025258 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ddc7d4f4-4ea7-4207-ae09-1c524c05ac5a tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:06.025394 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ddc7d4f4-4ea7-4207-ae09-1c524c05ac5a tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:06.025806 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ddc7d4f4-4ea7-4207-ae09-1c524c05ac5a tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:06.060285 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.wsgi [None req-ddc7d4f4-4ea7-4207-ae09-1c524c05ac5a tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] HTTP exception thrown: Instance 7a7441d1-fed1-484d-8802-a1ef5e016198 could not be found. Feb 16 14:30:06.062438 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-ddc7d4f4-4ea7-4207-ae09-1c524c05ac5a tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] Returning 404 to user: Instance 7a7441d1-fed1-484d-8802-a1ef5e016198 could not be found. {{(pid=117031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:30:06.063322 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-ddc7d4f4-4ea7-4207-ae09-1c524c05ac5a tempest-VolumesSnapshotTestJSON-1536211013 tempest-VolumesSnapshotTestJSON-1536211013-project] 10.222.0.110 "GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198" status: 404 len: 111 microversion: 2.1 time: 0.062398 Feb 16 14:30:06.067355 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 368/686] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:05 2022] GET /compute/v2.1/servers/7a7441d1-fed1-484d-8802-a1ef5e016198 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 14:30:06.079521 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-5bee9962-8c21-4ad9-a81c-77b6b732c2e8 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:06.080539 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-5bee9962-8c21-4ad9-a81c-77b6b732c2e8 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:06.090719 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5bee9962-8c21-4ad9-a81c-77b6b732c2e8 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:06.093108 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5bee9962-8c21-4ad9-a81c-77b6b732c2e8 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:06.095499 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5bee9962-8c21-4ad9-a81c-77b6b732c2e8 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:06.096068 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5bee9962-8c21-4ad9-a81c-77b6b732c2e8 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:06.389963 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-5bee9962-8c21-4ad9-a81c-77b6b732c2e8 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:06.416222 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-5bee9962-8c21-4ad9-a81c-77b6b732c2e8 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1362 microversion: 2.1 time: 0.352707 Feb 16 14:30:06.419680 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 319/687] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:06 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1362 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:06.805571 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-90d7d81e-f5ae-4d7e-8f57-f236adf3b4c7 req-3911d7f3-ac2a-40cc-a9db-08f27e9c3fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6354a804-6aae-4208-8eb6-6b821ac0ecde", "tag": "5ee4e35f-3743-4549-89fe-13d02ed7b538"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:30:06.806699 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:30:06.806699 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: warnings.warn(msg) Feb 16 14:30:06.811199 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-279544d7-d386-41d4-9a18-39679ed3904b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-690217873", "imageRef": "2493d2dc-e081-43d3-8292-91b4762a21e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b44c56ce-4ab9-4b55-a9f4-2cfe356cbeb8"}], "security_groups": [{"name": "tempest-securitygroup--125689646"}], "key_name": "tempest-keypair-941938357", "user_data": "}} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:30:06.832485 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-90d7d81e-f5ae-4d7e-8f57-f236adf3b4c7 req-3911d7f3-ac2a-40cc-a9db-08f27e9c3fb0 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:06.832935 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-90d7d81e-f5ae-4d7e-8f57-f236adf3b4c7 req-3911d7f3-ac2a-40cc-a9db-08f27e9c3fb0 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:06.889433 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-90d7d81e-f5ae-4d7e-8f57-f236adf3b4c7 req-3911d7f3-ac2a-40cc-a9db-08f27e9c3fb0 service nova] Creating event network-changed:5ee4e35f-3743-4549-89fe-13d02ed7b538 for instance 6354a804-6aae-4208-8eb6-6b821ac0ecde on hv-cinder-80473 Feb 16 14:30:06.895384 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-90d7d81e-f5ae-4d7e-8f57-f236adf3b4c7 req-3911d7f3-ac2a-40cc-a9db-08f27e9c3fb0 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093956 Feb 16 14:30:06.903066 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 320/688] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:30:06.921978 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-754f0801-ed0f-43cb-99f1-0b577657a67c tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:06.922763 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-754f0801-ed0f-43cb-99f1-0b577657a67c tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: 0185f443-9306-4933-b44f-814c65b3c0b9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:06.931914 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-754f0801-ed0f-43cb-99f1-0b577657a67c tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:06.934057 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-754f0801-ed0f-43cb-99f1-0b577657a67c tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:06.934057 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-754f0801-ed0f-43cb-99f1-0b577657a67c tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:06.934334 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-754f0801-ed0f-43cb-99f1-0b577657a67c tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:07.020172 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.network.neutron [None req-279544d7-d386-41d4-9a18-39679ed3904b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] validate_networks() for [('b44c56ce-4ab9-4b55-a9f4-2cfe356cbeb8', None, None, None, None, None)] {{(pid=117031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 16 14:30:07.137086 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-754f0801-ed0f-43cb-99f1-0b577657a67c tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:07.143722 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-754f0801-ed0f-43cb-99f1-0b577657a67c tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9" status: 200 len: 1322 microversion: 2.1 time: 0.226510 Feb 16 14:30:07.144290 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 321/689] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:06 2022] GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:07.418421 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-279544d7-d386-41d4-9a18-39679ed3904b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Flavor limits 0:0:0 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 16 14:30:07.419147 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-279544d7-d386-41d4-9a18-39679ed3904b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Image limits 0:0:0 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 16 14:30:07.419630 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-279544d7-d386-41d4-9a18-39679ed3904b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Flavor pref 0:0:0 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 16 14:30:07.420364 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-279544d7-d386-41d4-9a18-39679ed3904b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Image pref 0:0:0 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 16 14:30:07.420467 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-279544d7-d386-41d4-9a18-39679ed3904b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 16 14:30:07.431156 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-279544d7-d386-41d4-9a18-39679ed3904b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:07.431156 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-279544d7-d386-41d4-9a18-39679ed3904b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:07.431721 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-279544d7-d386-41d4-9a18-39679ed3904b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:07.432924 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-279544d7-d386-41d4-9a18-39679ed3904b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:07.438410 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-edc0bd9f-267e-4f07-8871-dc88c07d843f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:07.438410 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-edc0bd9f-267e-4f07-8871-dc88c07d843f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:07.450755 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-edc0bd9f-267e-4f07-8871-dc88c07d843f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:07.451333 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-edc0bd9f-267e-4f07-8871-dc88c07d843f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:07.452139 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-edc0bd9f-267e-4f07-8871-dc88c07d843f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:07.452577 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-edc0bd9f-267e-4f07-8871-dc88c07d843f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:07.457121 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.quota [None req-279544d7-d386-41d4-9a18-39679ed3904b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Getting quotas for project aeb2105b246e4f78bccf81a39b007f69. Resources: {'cores', 'instances', 'ram'} {{(pid=117031) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 14:30:07.462174 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.quota [None req-279544d7-d386-41d4-9a18-39679ed3904b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Getting quotas for user 745ca4a19a674037b9fee7f3778c05eb and project aeb2105b246e4f78bccf81a39b007f69. Resources: {'cores', 'instances', 'ram'} {{(pid=117031) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 14:30:07.475194 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-279544d7-d386-41d4-9a18-39679ed3904b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Going to run 1 instances... {{(pid=117031) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 16 14:30:07.478822 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-279544d7-d386-41d4-9a18-39679ed3904b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2493d2dc-e081-43d3-8292-91b4762a21e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 16 14:30:07.610655 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-279544d7-d386-41d4-9a18-39679ed3904b tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.20 time: 0.806077 Feb 16 14:30:07.610655 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 369/690] 10.222.0.110 () {62 vars in 1192 bytes} [Wed Feb 16 14:30:06 2022] POST /compute/v2.1/servers => generated 403 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Feb 16 14:30:07.622683 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-b1cfbde5-d18d-48a0-bccb-46774fa91d72 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:07.623290 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-b1cfbde5-d18d-48a0-bccb-46774fa91d72 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:07.624350 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-edc0bd9f-267e-4f07-8871-dc88c07d843f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:07.640758 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-edc0bd9f-267e-4f07-8871-dc88c07d843f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1362 microversion: 2.1 time: 0.207847 Feb 16 14:30:07.651300 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 322/691] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:07 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:30:07.716331 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-b1cfbde5-d18d-48a0-bccb-46774fa91d72 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:07.725278 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-b1cfbde5-d18d-48a0-bccb-46774fa91d72 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:07.729197 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-b1cfbde5-d18d-48a0-bccb-46774fa91d72 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:07.737893 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-b1cfbde5-d18d-48a0-bccb-46774fa91d72 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1284 microversion: 2.20 time: 0.118869 Feb 16 14:30:07.738540 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 370/692] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:30:07 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:30:08.160624 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-73874569-5acb-4d6d-aa54-ac7f8b51d81a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:08.161862 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-73874569-5acb-4d6d-aa54-ac7f8b51d81a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: 0185f443-9306-4933-b44f-814c65b3c0b9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:08.177055 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-73874569-5acb-4d6d-aa54-ac7f8b51d81a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:08.177592 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-73874569-5acb-4d6d-aa54-ac7f8b51d81a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:08.178599 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-73874569-5acb-4d6d-aa54-ac7f8b51d81a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:08.179064 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-73874569-5acb-4d6d-aa54-ac7f8b51d81a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:08.339623 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-73874569-5acb-4d6d-aa54-ac7f8b51d81a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:08.347167 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-73874569-5acb-4d6d-aa54-ac7f8b51d81a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9" status: 200 len: 1322 microversion: 2.1 time: 0.190209 Feb 16 14:30:08.347768 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 323/693] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:08 2022] GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:08.660088 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-c038f1f6-9fea-426e-9c8f-71cd7a9f4a69 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:08.661570 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-c038f1f6-9fea-426e-9c8f-71cd7a9f4a69 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:08.685057 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c038f1f6-9fea-426e-9c8f-71cd7a9f4a69 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:08.685671 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c038f1f6-9fea-426e-9c8f-71cd7a9f4a69 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:08.686461 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c038f1f6-9fea-426e-9c8f-71cd7a9f4a69 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:08.686955 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c038f1f6-9fea-426e-9c8f-71cd7a9f4a69 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:08.756325 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-4e1308d4-707b-415f-9e28-940791f6ceec tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:08.756850 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-4e1308d4-707b-415f-9e28-940791f6ceec tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:08.763306 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4e1308d4-707b-415f-9e28-940791f6ceec tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:08.763757 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4e1308d4-707b-415f-9e28-940791f6ceec tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:08.764544 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4e1308d4-707b-415f-9e28-940791f6ceec tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:08.764977 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4e1308d4-707b-415f-9e28-940791f6ceec tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:08.834011 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-c038f1f6-9fea-426e-9c8f-71cd7a9f4a69 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:08.835943 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-4e1308d4-707b-415f-9e28-940791f6ceec tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:08.847860 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-4e1308d4-707b-415f-9e28-940791f6ceec tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:08.849428 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-4e1308d4-707b-415f-9e28-940791f6ceec tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:08.849902 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-c038f1f6-9fea-426e-9c8f-71cd7a9f4a69 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1362 microversion: 2.1 time: 0.195818 Feb 16 14:30:08.850483 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 371/694] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:08 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:08.850654 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-4e1308d4-707b-415f-9e28-940791f6ceec tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1288 microversion: 2.20 time: 0.098068 Feb 16 14:30:08.851349 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 324/695] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:30:08 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1288 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:30:09.366187 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-55aaaf7e-09a4-4e59-890e-1c24f0b295ab tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:09.366818 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-55aaaf7e-09a4-4e59-890e-1c24f0b295ab tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: 0185f443-9306-4933-b44f-814c65b3c0b9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:09.373580 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-55aaaf7e-09a4-4e59-890e-1c24f0b295ab tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:09.374249 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-55aaaf7e-09a4-4e59-890e-1c24f0b295ab tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:09.375215 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-55aaaf7e-09a4-4e59-890e-1c24f0b295ab tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:09.375790 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-55aaaf7e-09a4-4e59-890e-1c24f0b295ab tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:09.554114 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-55aaaf7e-09a4-4e59-890e-1c24f0b295ab tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:09.563131 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-55aaaf7e-09a4-4e59-890e-1c24f0b295ab tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9" status: 200 len: 1322 microversion: 2.1 time: 0.200362 Feb 16 14:30:09.566831 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 372/696] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:09 2022] GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:09.867564 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-737e949f-f8ca-498b-b9c4-f97aa75f84fd tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:09.868272 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-61af32be-5aa7-4279-9029-4faa87ddeadb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:09.868641 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-737e949f-f8ca-498b-b9c4-f97aa75f84fd tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:09.868854 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-61af32be-5aa7-4279-9029-4faa87ddeadb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:09.874732 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-737e949f-f8ca-498b-b9c4-f97aa75f84fd tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:09.874864 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-61af32be-5aa7-4279-9029-4faa87ddeadb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:09.875184 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-737e949f-f8ca-498b-b9c4-f97aa75f84fd tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:09.875298 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-61af32be-5aa7-4279-9029-4faa87ddeadb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:09.875971 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-737e949f-f8ca-498b-b9c4-f97aa75f84fd tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:09.876082 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-61af32be-5aa7-4279-9029-4faa87ddeadb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:09.876439 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-737e949f-f8ca-498b-b9c4-f97aa75f84fd tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:09.876546 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-61af32be-5aa7-4279-9029-4faa87ddeadb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:09.942553 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-61af32be-5aa7-4279-9029-4faa87ddeadb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:09.951311 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-61af32be-5aa7-4279-9029-4faa87ddeadb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:09.954235 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-61af32be-5aa7-4279-9029-4faa87ddeadb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:09.955423 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-61af32be-5aa7-4279-9029-4faa87ddeadb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1288 microversion: 2.20 time: 0.091245 Feb 16 14:30:09.957297 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 373/697] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:30:09 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1288 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:30:10.027774 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-737e949f-f8ca-498b-b9c4-f97aa75f84fd tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:10.035237 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-737e949f-f8ca-498b-b9c4-f97aa75f84fd tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1362 microversion: 2.1 time: 0.171599 Feb 16 14:30:10.035808 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 325/698] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:09 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:10.580981 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-5419c50d-e08f-4860-958b-f2fc26cc497b tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:10.581577 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-5419c50d-e08f-4860-958b-f2fc26cc497b tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: 0185f443-9306-4933-b44f-814c65b3c0b9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:10.587819 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5419c50d-e08f-4860-958b-f2fc26cc497b tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:10.588277 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5419c50d-e08f-4860-958b-f2fc26cc497b tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:10.589094 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5419c50d-e08f-4860-958b-f2fc26cc497b tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:10.589528 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5419c50d-e08f-4860-958b-f2fc26cc497b tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:10.735949 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-5419c50d-e08f-4860-958b-f2fc26cc497b tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:10.745814 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-5419c50d-e08f-4860-958b-f2fc26cc497b tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9" status: 200 len: 1322 microversion: 2.1 time: 0.168267 Feb 16 14:30:10.755921 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 374/699] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:10 2022] GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:10.973851 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-bd6284d5-09d2-4ed8-9d8b-ea32c4ca9a7d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:10.975170 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-bd6284d5-09d2-4ed8-9d8b-ea32c4ca9a7d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:10.984540 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bd6284d5-09d2-4ed8-9d8b-ea32c4ca9a7d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:10.985003 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bd6284d5-09d2-4ed8-9d8b-ea32c4ca9a7d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:10.985798 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bd6284d5-09d2-4ed8-9d8b-ea32c4ca9a7d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:10.986241 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bd6284d5-09d2-4ed8-9d8b-ea32c4ca9a7d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:11.052259 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-bd6284d5-09d2-4ed8-9d8b-ea32c4ca9a7d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:11.052455 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-457538ef-3ce1-450b-ad3a-1f4d0205e59f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:11.053005 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-457538ef-3ce1-450b-ad3a-1f4d0205e59f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:11.060776 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-457538ef-3ce1-450b-ad3a-1f4d0205e59f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:11.065937 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-457538ef-3ce1-450b-ad3a-1f4d0205e59f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:11.065937 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-457538ef-3ce1-450b-ad3a-1f4d0205e59f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:11.066177 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-bd6284d5-09d2-4ed8-9d8b-ea32c4ca9a7d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:11.066284 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-457538ef-3ce1-450b-ad3a-1f4d0205e59f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:11.066378 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-bd6284d5-09d2-4ed8-9d8b-ea32c4ca9a7d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:11.066378 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-bd6284d5-09d2-4ed8-9d8b-ea32c4ca9a7d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1288 microversion: 2.20 time: 0.095176 Feb 16 14:30:11.066378 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 326/700] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:30:10 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1288 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:30:11.210109 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-457538ef-3ce1-450b-ad3a-1f4d0205e59f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:11.217860 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-457538ef-3ce1-450b-ad3a-1f4d0205e59f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1362 microversion: 2.1 time: 0.169717 Feb 16 14:30:11.218429 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 375/701] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:11 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:30:11.763920 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f5743988-a713-4198-99a4-085dc2864ef6 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:11.764485 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f5743988-a713-4198-99a4-085dc2864ef6 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: 0185f443-9306-4933-b44f-814c65b3c0b9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:11.771044 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f5743988-a713-4198-99a4-085dc2864ef6 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:11.771495 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f5743988-a713-4198-99a4-085dc2864ef6 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:11.772300 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f5743988-a713-4198-99a4-085dc2864ef6 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:11.772735 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f5743988-a713-4198-99a4-085dc2864ef6 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:12.086534 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-a9092d84-75cc-4b6c-a35f-d6bf8ed72853 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:12.088077 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-a9092d84-75cc-4b6c-a35f-d6bf8ed72853 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:12.095260 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a9092d84-75cc-4b6c-a35f-d6bf8ed72853 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:12.096127 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a9092d84-75cc-4b6c-a35f-d6bf8ed72853 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:12.097223 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a9092d84-75cc-4b6c-a35f-d6bf8ed72853 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:12.097894 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a9092d84-75cc-4b6c-a35f-d6bf8ed72853 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:12.246662 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-a9092d84-75cc-4b6c-a35f-d6bf8ed72853 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:12.246662 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-a9092d84-75cc-4b6c-a35f-d6bf8ed72853 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:12.247433 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-a9092d84-75cc-4b6c-a35f-d6bf8ed72853 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:12.247433 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-a9092d84-75cc-4b6c-a35f-d6bf8ed72853 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1288 microversion: 2.20 time: 0.136630 Feb 16 14:30:12.247433 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 376/702] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:30:12 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1288 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:30:12.247813 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-3e2bf53b-e532-46f7-8505-9b98abba26d5 req-64a04373-a409-4b39-bc32-e3445707401e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0185f443-9306-4933-b44f-814c65b3c0b9", "name": "network-vif-plugged", "status": "completed", "tag": "f45e1896-cbac-4079-bf31-95878784e9ba"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:30:12.247813 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:30:12.247813 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:30:12.247813 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-3e2bf53b-e532-46f7-8505-9b98abba26d5 req-64a04373-a409-4b39-bc32-e3445707401e service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:12.247813 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-3e2bf53b-e532-46f7-8505-9b98abba26d5 req-64a04373-a409-4b39-bc32-e3445707401e service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:12.252658 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-3e2bf53b-e532-46f7-8505-9b98abba26d5 req-64a04373-a409-4b39-bc32-e3445707401e service nova] Creating event network-vif-plugged:f45e1896-cbac-4079-bf31-95878784e9ba for instance 0185f443-9306-4933-b44f-814c65b3c0b9 on hv-cinder-80473 Feb 16 14:30:12.260239 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-3e2bf53b-e532-46f7-8505-9b98abba26d5 req-64a04373-a409-4b39-bc32-e3445707401e service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040483 Feb 16 14:30:12.261733 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 377/703] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:30:12.267794 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-4b0dd7d8-79cc-4cdd-b10c-f831828963e3 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:12.268575 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-4b0dd7d8-79cc-4cdd-b10c-f831828963e3 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:12.274835 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4b0dd7d8-79cc-4cdd-b10c-f831828963e3 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:12.275289 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4b0dd7d8-79cc-4cdd-b10c-f831828963e3 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:12.276082 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4b0dd7d8-79cc-4cdd-b10c-f831828963e3 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:12.276519 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4b0dd7d8-79cc-4cdd-b10c-f831828963e3 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:12.279716 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f5743988-a713-4198-99a4-085dc2864ef6 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:12.288205 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f5743988-a713-4198-99a4-085dc2864ef6 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9" status: 200 len: 1322 microversion: 2.1 time: 0.528194 Feb 16 14:30:12.289541 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 327/704] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:11 2022] GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9 => generated 1322 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:12.465011 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-4b0dd7d8-79cc-4cdd-b10c-f831828963e3 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:12.475073 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-4b0dd7d8-79cc-4cdd-b10c-f831828963e3 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1362 microversion: 2.1 time: 0.211171 Feb 16 14:30:12.475801 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 378/705] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:12 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:13.238653 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-04cb38e8-dc6d-4477-a197-fd462a704899 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:13.239606 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-04cb38e8-dc6d-4477-a197-fd462a704899 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:13.247120 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-04cb38e8-dc6d-4477-a197-fd462a704899 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:13.247662 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-04cb38e8-dc6d-4477-a197-fd462a704899 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:13.248644 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-04cb38e8-dc6d-4477-a197-fd462a704899 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:13.249093 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-04cb38e8-dc6d-4477-a197-fd462a704899 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:13.306743 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-690d0a9e-39e8-4ce8-8733-ef34d19a5161 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:13.307459 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-690d0a9e-39e8-4ce8-8733-ef34d19a5161 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: 0185f443-9306-4933-b44f-814c65b3c0b9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:13.310718 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-04cb38e8-dc6d-4477-a197-fd462a704899 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:13.322796 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-690d0a9e-39e8-4ce8-8733-ef34d19a5161 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:13.322796 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-690d0a9e-39e8-4ce8-8733-ef34d19a5161 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:13.322796 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-690d0a9e-39e8-4ce8-8733-ef34d19a5161 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:13.322796 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-690d0a9e-39e8-4ce8-8733-ef34d19a5161 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:13.323160 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-04cb38e8-dc6d-4477-a197-fd462a704899 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:13.326956 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-04cb38e8-dc6d-4477-a197-fd462a704899 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:13.326956 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-04cb38e8-dc6d-4477-a197-fd462a704899 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1288 microversion: 2.20 time: 0.092842 Feb 16 14:30:13.337542 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 328/706] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:30:13 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1288 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:30:13.472319 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-690d0a9e-39e8-4ce8-8733-ef34d19a5161 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:13.482188 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-690d0a9e-39e8-4ce8-8733-ef34d19a5161 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9" status: 200 len: 1322 microversion: 2.1 time: 0.180340 Feb 16 14:30:13.492657 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 379/707] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:13 2022] GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:30:13.507817 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f85409be-ded9-4fe6-b24d-8fd5b5acf793 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:13.509625 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f85409be-ded9-4fe6-b24d-8fd5b5acf793 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:13.516927 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f85409be-ded9-4fe6-b24d-8fd5b5acf793 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:13.517387 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f85409be-ded9-4fe6-b24d-8fd5b5acf793 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:13.518187 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f85409be-ded9-4fe6-b24d-8fd5b5acf793 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:13.518664 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f85409be-ded9-4fe6-b24d-8fd5b5acf793 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:13.680122 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f85409be-ded9-4fe6-b24d-8fd5b5acf793 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:13.690463 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f85409be-ded9-4fe6-b24d-8fd5b5acf793 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1362 microversion: 2.1 time: 0.194580 Feb 16 14:30:13.691642 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 329/708] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:13 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1362 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:14.346061 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-08a34bd2-ced6-4e01-aa53-65444a6d4df9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:14.346836 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-08a34bd2-ced6-4e01-aa53-65444a6d4df9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:14.355304 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-08a34bd2-ced6-4e01-aa53-65444a6d4df9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:14.356079 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-08a34bd2-ced6-4e01-aa53-65444a6d4df9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:14.357045 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-08a34bd2-ced6-4e01-aa53-65444a6d4df9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:14.357675 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-08a34bd2-ced6-4e01-aa53-65444a6d4df9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:14.449368 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-08a34bd2-ced6-4e01-aa53-65444a6d4df9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:14.459004 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-08a34bd2-ced6-4e01-aa53-65444a6d4df9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:14.460633 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-08a34bd2-ced6-4e01-aa53-65444a6d4df9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:14.465414 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-08a34bd2-ced6-4e01-aa53-65444a6d4df9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1288 microversion: 2.20 time: 0.121092 Feb 16 14:30:14.473703 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 380/709] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:30:14 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1288 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:30:14.500116 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f31a9b43-0f44-4b76-8482-29c578878f78 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:14.500880 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f31a9b43-0f44-4b76-8482-29c578878f78 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: 0185f443-9306-4933-b44f-814c65b3c0b9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:14.512421 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f31a9b43-0f44-4b76-8482-29c578878f78 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:14.513056 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f31a9b43-0f44-4b76-8482-29c578878f78 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:14.513939 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f31a9b43-0f44-4b76-8482-29c578878f78 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:14.514389 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f31a9b43-0f44-4b76-8482-29c578878f78 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:14.683935 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f31a9b43-0f44-4b76-8482-29c578878f78 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:14.693695 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f31a9b43-0f44-4b76-8482-29c578878f78 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9" status: 200 len: 1322 microversion: 2.1 time: 0.197805 Feb 16 14:30:14.704998 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 330/710] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:14 2022] GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:14.707984 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-3c2cc8f1-76f0-4b6c-b0c4-d54fa693d2ab tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:14.708729 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-3c2cc8f1-76f0-4b6c-b0c4-d54fa693d2ab tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:14.718054 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3c2cc8f1-76f0-4b6c-b0c4-d54fa693d2ab tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:14.718054 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3c2cc8f1-76f0-4b6c-b0c4-d54fa693d2ab tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:14.718286 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3c2cc8f1-76f0-4b6c-b0c4-d54fa693d2ab tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:14.718559 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3c2cc8f1-76f0-4b6c-b0c4-d54fa693d2ab tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:15.080812 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-3c2cc8f1-76f0-4b6c-b0c4-d54fa693d2ab tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:15.089420 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-3c2cc8f1-76f0-4b6c-b0c4-d54fa693d2ab tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1362 microversion: 2.1 time: 0.385298 Feb 16 14:30:15.092764 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 381/711] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:14 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1362 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:30:15.484039 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-3a659ef7-f831-42b7-8a22-247e7cb91707 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:15.484760 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-3a659ef7-f831-42b7-8a22-247e7cb91707 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:15.491065 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3a659ef7-f831-42b7-8a22-247e7cb91707 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:15.491649 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3a659ef7-f831-42b7-8a22-247e7cb91707 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:15.493309 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3a659ef7-f831-42b7-8a22-247e7cb91707 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:15.493903 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3a659ef7-f831-42b7-8a22-247e7cb91707 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:15.561339 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3a659ef7-f831-42b7-8a22-247e7cb91707 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:15.569976 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3a659ef7-f831-42b7-8a22-247e7cb91707 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:15.572387 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3a659ef7-f831-42b7-8a22-247e7cb91707 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:15.573723 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-3a659ef7-f831-42b7-8a22-247e7cb91707 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1288 microversion: 2.20 time: 0.093583 Feb 16 14:30:15.582680 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 331/712] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:30:15 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1288 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:30:15.715232 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-db611baa-9a60-44f0-bb38-5a6a0e16e0cb tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:15.715919 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-db611baa-9a60-44f0-bb38-5a6a0e16e0cb tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: 0185f443-9306-4933-b44f-814c65b3c0b9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:15.731751 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-db611baa-9a60-44f0-bb38-5a6a0e16e0cb tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:15.734809 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-db611baa-9a60-44f0-bb38-5a6a0e16e0cb tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:15.734809 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-db611baa-9a60-44f0-bb38-5a6a0e16e0cb tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:15.734809 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-db611baa-9a60-44f0-bb38-5a6a0e16e0cb tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:15.889484 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-db611baa-9a60-44f0-bb38-5a6a0e16e0cb tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:15.897565 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-db611baa-9a60-44f0-bb38-5a6a0e16e0cb tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9" status: 200 len: 1322 microversion: 2.1 time: 0.189329 Feb 16 14:30:15.905348 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 382/713] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:15 2022] GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9 => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:16.106751 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-121a14fc-1fc0-49a5-ad88-c79c3a68c86f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:16.275954 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-121a14fc-1fc0-49a5-ad88-c79c3a68c86f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:16.275954 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-121a14fc-1fc0-49a5-ad88-c79c3a68c86f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:16.275954 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-121a14fc-1fc0-49a5-ad88-c79c3a68c86f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:16.275954 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-121a14fc-1fc0-49a5-ad88-c79c3a68c86f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:16.276651 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-121a14fc-1fc0-49a5-ad88-c79c3a68c86f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:16.341086 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-121a14fc-1fc0-49a5-ad88-c79c3a68c86f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:16.350227 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-121a14fc-1fc0-49a5-ad88-c79c3a68c86f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1362 microversion: 2.1 time: 0.247222 Feb 16 14:30:16.350903 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 332/714] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:16 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1362 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:30:16.592124 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-8c911d23-7240-4cd3-baa9-2416a711d843 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:16.592723 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-8c911d23-7240-4cd3-baa9-2416a711d843 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:16.598886 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8c911d23-7240-4cd3-baa9-2416a711d843 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:16.599352 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8c911d23-7240-4cd3-baa9-2416a711d843 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:16.600112 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8c911d23-7240-4cd3-baa9-2416a711d843 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:16.600535 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8c911d23-7240-4cd3-baa9-2416a711d843 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:16.663151 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-8c911d23-7240-4cd3-baa9-2416a711d843 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:16.673222 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-8c911d23-7240-4cd3-baa9-2416a711d843 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:16.675793 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-8c911d23-7240-4cd3-baa9-2416a711d843 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:16.676774 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-8c911d23-7240-4cd3-baa9-2416a711d843 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1336 microversion: 2.20 time: 0.088421 Feb 16 14:30:16.677332 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 383/715] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:30:16 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1336 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:30:16.915140 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-620024a3-f2e2-4466-af64-c7c56fdef26b tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:16.915714 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-620024a3-f2e2-4466-af64-c7c56fdef26b tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: 0185f443-9306-4933-b44f-814c65b3c0b9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:16.922034 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-620024a3-f2e2-4466-af64-c7c56fdef26b tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:16.922495 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-620024a3-f2e2-4466-af64-c7c56fdef26b tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:16.923316 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-620024a3-f2e2-4466-af64-c7c56fdef26b tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:16.923759 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-620024a3-f2e2-4466-af64-c7c56fdef26b tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:17.074165 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-620024a3-f2e2-4466-af64-c7c56fdef26b tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:17.081995 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-620024a3-f2e2-4466-af64-c7c56fdef26b tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9" status: 200 len: 1322 microversion: 2.1 time: 0.172084 Feb 16 14:30:17.082497 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 333/716] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:16 2022] GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:17.369793 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-1157432f-30e5-4cc8-80db-82136ca956fc tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:17.370351 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-1157432f-30e5-4cc8-80db-82136ca956fc tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:17.377096 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1157432f-30e5-4cc8-80db-82136ca956fc tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:17.377549 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1157432f-30e5-4cc8-80db-82136ca956fc tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:17.378337 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1157432f-30e5-4cc8-80db-82136ca956fc tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:17.378838 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1157432f-30e5-4cc8-80db-82136ca956fc tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:17.527601 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-1157432f-30e5-4cc8-80db-82136ca956fc tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:17.535136 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-1157432f-30e5-4cc8-80db-82136ca956fc tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1362 microversion: 2.1 time: 0.169685 Feb 16 14:30:17.538075 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 384/717] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:17 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:17.696154 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-97faf43f-2045-4014-9df9-0641f8808538 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:17.696933 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-97faf43f-2045-4014-9df9-0641f8808538 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:17.703254 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-97faf43f-2045-4014-9df9-0641f8808538 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:17.704294 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-97faf43f-2045-4014-9df9-0641f8808538 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:17.704481 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-97faf43f-2045-4014-9df9-0641f8808538 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:17.704924 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-97faf43f-2045-4014-9df9-0641f8808538 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:17.770652 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-97faf43f-2045-4014-9df9-0641f8808538 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:17.779290 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-97faf43f-2045-4014-9df9-0641f8808538 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:17.780856 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-97faf43f-2045-4014-9df9-0641f8808538 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:17.781967 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-97faf43f-2045-4014-9df9-0641f8808538 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1354 microversion: 2.20 time: 0.090380 Feb 16 14:30:17.782530 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 334/718] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:30:17 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:30:18.098836 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-34f44f5b-aa20-4c33-bdb1-9572af6751a3 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:18.099641 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-34f44f5b-aa20-4c33-bdb1-9572af6751a3 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: 0185f443-9306-4933-b44f-814c65b3c0b9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:18.106130 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-34f44f5b-aa20-4c33-bdb1-9572af6751a3 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:18.106582 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-34f44f5b-aa20-4c33-bdb1-9572af6751a3 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:18.107404 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-34f44f5b-aa20-4c33-bdb1-9572af6751a3 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:18.107864 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-34f44f5b-aa20-4c33-bdb1-9572af6751a3 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:18.242434 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-34f44f5b-aa20-4c33-bdb1-9572af6751a3 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:18.256306 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-34f44f5b-aa20-4c33-bdb1-9572af6751a3 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9" status: 200 len: 1512 microversion: 2.1 time: 0.160224 Feb 16 14:30:18.258363 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 385/719] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:18 2022] GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9 => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:18.275409 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-1e379804-ceff-43af-98d6-856360a6ade6 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2fb466b-baef-4a6d-971e-eb681d05560e"}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:30:18.276560 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-1e379804-ceff-43af-98d6-856360a6ade6 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: 0185f443-9306-4933-b44f-814c65b3c0b9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:18.283517 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1e379804-ceff-43af-98d6-856360a6ade6 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:18.284198 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1e379804-ceff-43af-98d6-856360a6ade6 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:18.285070 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1e379804-ceff-43af-98d6-856360a6ade6 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:18.285518 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1e379804-ceff-43af-98d6-856360a6ade6 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:18.384395 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-1e379804-ceff-43af-98d6-856360a6ade6 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] HTTP exception thrown: Invalid volume: volume a2fb466b-baef-4a6d-971e-eb681d05560e is already attached to instances: f8777fc7-22f6-4dcf-885c-c08aa877b001 Feb 16 14:30:18.385017 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-1e379804-ceff-43af-98d6-856360a6ade6 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Returning 400 to user: Invalid volume: volume a2fb466b-baef-4a6d-971e-eb681d05560e is already attached to instances: f8777fc7-22f6-4dcf-885c-c08aa877b001 {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:30:18.385884 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-1e379804-ceff-43af-98d6-856360a6ade6 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "POST /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.114783 Feb 16 14:30:18.386551 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 335/720] 10.222.0.110 () {60 vars in 1327 bytes} [Wed Feb 16 14:30:18 2022] POST /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9/os-volume_attachments => generated 174 bytes in 116 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Feb 16 14:30:18.452668 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-a8d505b5-6760-462d-9c13-9b1370cf94d3 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:18.453429 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-a8d505b5-6760-462d-9c13-9b1370cf94d3 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f8777fc7-22f6-4dcf-885c-c08aa877b001] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:18.464301 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a8d505b5-6760-462d-9c13-9b1370cf94d3 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:18.470958 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a8d505b5-6760-462d-9c13-9b1370cf94d3 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:18.470958 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a8d505b5-6760-462d-9c13-9b1370cf94d3 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:18.470958 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a8d505b5-6760-462d-9c13-9b1370cf94d3 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:18.553317 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-34cc02fe-d2a0-4105-8603-b3a227f6c8fd tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:18.554213 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-34cc02fe-d2a0-4105-8603-b3a227f6c8fd tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:18.563196 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-34cc02fe-d2a0-4105-8603-b3a227f6c8fd tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:18.564199 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-34cc02fe-d2a0-4105-8603-b3a227f6c8fd tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:18.565261 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-34cc02fe-d2a0-4105-8603-b3a227f6c8fd tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:18.565893 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-34cc02fe-d2a0-4105-8603-b3a227f6c8fd tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:18.587044 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.objects.instance [None req-a8d505b5-6760-462d-9c13-9b1370cf94d3 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lazy-loading 'services' on Instance uuid f8777fc7-22f6-4dcf-885c-c08aa877b001 {{(pid=117031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:30:18.818723 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-a8d505b5-6760-462d-9c13-9b1370cf94d3 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "DELETE /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001/os-volume_attachments/a2fb466b-baef-4a6d-971e-eb681d05560e" status: 202 len: 0 microversion: 2.1 time: 0.373912 Feb 16 14:30:18.820873 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 386/721] 10.222.0.110 () {58 vars in 1420 bytes} [Wed Feb 16 14:30:18 2022] DELETE /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001/os-volume_attachments/a2fb466b-baef-4a6d-971e-eb681d05560e => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 14:30:18.845830 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-3a7fd6ff-2341-4743-8881-361e4d2e530f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:18.850385 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-3a7fd6ff-2341-4743-8881-361e4d2e530f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:18.859711 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3a7fd6ff-2341-4743-8881-361e4d2e530f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:18.864294 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-34cc02fe-d2a0-4105-8603-b3a227f6c8fd tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:18.867869 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3a7fd6ff-2341-4743-8881-361e4d2e530f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:18.869803 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3a7fd6ff-2341-4743-8881-361e4d2e530f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:18.870608 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3a7fd6ff-2341-4743-8881-361e4d2e530f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:18.876516 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-34cc02fe-d2a0-4105-8603-b3a227f6c8fd tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1362 microversion: 2.1 time: 0.325703 Feb 16 14:30:18.878228 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 336/722] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:18 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1362 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:18.883602 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-8db8e21e-3a1b-4c8a-bd04-e4224ff3b866 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:18.885395 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-8db8e21e-3a1b-4c8a-bd04-e4224ff3b866 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f8777fc7-22f6-4dcf-885c-c08aa877b001] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:18.892930 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8db8e21e-3a1b-4c8a-bd04-e4224ff3b866 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:18.893766 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8db8e21e-3a1b-4c8a-bd04-e4224ff3b866 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:18.894756 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8db8e21e-3a1b-4c8a-bd04-e4224ff3b866 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:18.895365 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8db8e21e-3a1b-4c8a-bd04-e4224ff3b866 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:18.930663 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-8db8e21e-3a1b-4c8a-bd04-e4224ff3b866 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051001 Feb 16 14:30:18.931606 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 337/723] 10.222.0.110 () {58 vars in 1306 bytes} [Wed Feb 16 14:30:18 2022] GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:30:19.347884 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-3a7fd6ff-2341-4743-8881-361e4d2e530f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:19.357199 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-3a7fd6ff-2341-4743-8881-361e4d2e530f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:19.359247 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-3a7fd6ff-2341-4743-8881-361e4d2e530f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:19.360752 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-3a7fd6ff-2341-4743-8881-361e4d2e530f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1409 microversion: 2.20 time: 0.538224 Feb 16 14:30:19.361320 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 387/724] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:30:18 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1409 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:30:19.438839 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-c5cb3ffd-f27a-4984-8d6b-146c4032e620 req-97168dcb-3de0-40e0-971e-caed2fdcbce6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "542bf2d6-2c49-48e1-a903-3a14bcfb1b0d", "tag": "c35750d8-fe77-4744-8fd1-c9914d7c2435"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:30:19.441766 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:30:19.441766 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: warnings.warn(msg) Feb 16 14:30:19.449409 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-c5cb3ffd-f27a-4984-8d6b-146c4032e620 req-97168dcb-3de0-40e0-971e-caed2fdcbce6 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:19.449854 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-c5cb3ffd-f27a-4984-8d6b-146c4032e620 req-97168dcb-3de0-40e0-971e-caed2fdcbce6 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:19.461953 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-c5cb3ffd-f27a-4984-8d6b-146c4032e620 req-97168dcb-3de0-40e0-971e-caed2fdcbce6 service nova] Creating event network-changed:c35750d8-fe77-4744-8fd1-c9914d7c2435 for instance 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d on hv-cinder-80473 Feb 16 14:30:19.467025 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-c5cb3ffd-f27a-4984-8d6b-146c4032e620 req-97168dcb-3de0-40e0-971e-caed2fdcbce6 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031801 Feb 16 14:30:19.467998 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 338/725] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:30:19.901858 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-009b3e83-dfbb-4d72-9215-a43525d4b608 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:19.902484 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-009b3e83-dfbb-4d72-9215-a43525d4b608 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:19.912739 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-009b3e83-dfbb-4d72-9215-a43525d4b608 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:19.913326 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-009b3e83-dfbb-4d72-9215-a43525d4b608 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:19.914897 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-009b3e83-dfbb-4d72-9215-a43525d4b608 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:19.915641 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-009b3e83-dfbb-4d72-9215-a43525d4b608 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:19.953715 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f7f514da-b3c6-4a74-a8fd-9997f12ea192 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:19.955525 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f7f514da-b3c6-4a74-a8fd-9997f12ea192 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f8777fc7-22f6-4dcf-885c-c08aa877b001] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:19.964632 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f7f514da-b3c6-4a74-a8fd-9997f12ea192 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:19.965185 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f7f514da-b3c6-4a74-a8fd-9997f12ea192 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:19.966263 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f7f514da-b3c6-4a74-a8fd-9997f12ea192 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:19.966736 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f7f514da-b3c6-4a74-a8fd-9997f12ea192 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:20.022282 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f7f514da-b3c6-4a74-a8fd-9997f12ea192 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076884 Feb 16 14:30:20.024063 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 339/726] 10.222.0.110 () {58 vars in 1306 bytes} [Wed Feb 16 14:30:19 2022] GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 14:30:20.146074 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-009b3e83-dfbb-4d72-9215-a43525d4b608 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:20.154006 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-009b3e83-dfbb-4d72-9215-a43525d4b608 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1362 microversion: 2.1 time: 0.256694 Feb 16 14:30:20.154602 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 388/727] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:19 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1362 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:20.379624 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-1623f806-9e81-4310-953c-20135fec9405 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:20.380235 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-1623f806-9e81-4310-953c-20135fec9405 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:20.387030 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1623f806-9e81-4310-953c-20135fec9405 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:20.387479 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1623f806-9e81-4310-953c-20135fec9405 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:20.388265 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1623f806-9e81-4310-953c-20135fec9405 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:20.388707 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1623f806-9e81-4310-953c-20135fec9405 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:20.582226 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-1623f806-9e81-4310-953c-20135fec9405 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:20.591650 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-1623f806-9e81-4310-953c-20135fec9405 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:20.594840 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-1623f806-9e81-4310-953c-20135fec9405 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:20.594840 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-1623f806-9e81-4310-953c-20135fec9405 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1409 microversion: 2.20 time: 0.218928 Feb 16 14:30:20.595223 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 340/728] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:30:20 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1409 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:30:21.036988 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-f4891f2a-d904-4504-877c-f70d9b04e636 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:21.039984 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-f4891f2a-d904-4504-877c-f70d9b04e636 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f8777fc7-22f6-4dcf-885c-c08aa877b001] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:21.048219 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f4891f2a-d904-4504-877c-f70d9b04e636 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:21.048662 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f4891f2a-d904-4504-877c-f70d9b04e636 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:21.049515 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f4891f2a-d904-4504-877c-f70d9b04e636 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:21.049956 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f4891f2a-d904-4504-877c-f70d9b04e636 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:21.090589 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-f4891f2a-d904-4504-877c-f70d9b04e636 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057915 Feb 16 14:30:21.092255 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 389/729] 10.222.0.110 () {58 vars in 1306 bytes} [Wed Feb 16 14:30:21 2022] GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 16 14:30:21.173509 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-14ae65d7-b1e7-466d-a7bf-236805a22cf2 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:21.174144 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-14ae65d7-b1e7-466d-a7bf-236805a22cf2 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:21.181271 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-14ae65d7-b1e7-466d-a7bf-236805a22cf2 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:21.181726 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-14ae65d7-b1e7-466d-a7bf-236805a22cf2 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:21.182527 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-14ae65d7-b1e7-466d-a7bf-236805a22cf2 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:21.182995 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-14ae65d7-b1e7-466d-a7bf-236805a22cf2 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:21.272092 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-8b317f63-3403-4312-b739-13ae34b5c62f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1622360767", "imageRef": "2493d2dc-e081-43d3-8292-91b4762a21e8", "flavorRef": "452", "networks": [{"uuid": "36f39343-766a-4d7f-8597-906aa4ce6697"}]}} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:30:21.334507 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.network.neutron [None req-8b317f63-3403-4312-b739-13ae34b5c62f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] validate_networks() for [('36f39343-766a-4d7f-8597-906aa4ce6697', None, None, None, None, None)] {{(pid=117031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 16 14:30:21.352887 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-14ae65d7-b1e7-466d-a7bf-236805a22cf2 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:21.360268 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-14ae65d7-b1e7-466d-a7bf-236805a22cf2 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1362 microversion: 2.1 time: 0.193541 Feb 16 14:30:21.361091 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 341/730] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:21 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:30:21.612591 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6ca1e03b-659c-47f0-8d5b-3d32927ce556 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:21.613172 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-6ca1e03b-659c-47f0-8d5b-3d32927ce556 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:21.622284 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6ca1e03b-659c-47f0-8d5b-3d32927ce556 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:21.622761 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6ca1e03b-659c-47f0-8d5b-3d32927ce556 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:21.623545 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6ca1e03b-659c-47f0-8d5b-3d32927ce556 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:21.624234 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6ca1e03b-659c-47f0-8d5b-3d32927ce556 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:21.711301 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-8b317f63-3403-4312-b739-13ae34b5c62f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Flavor limits 0:0:0 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 16 14:30:21.711723 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-8b317f63-3403-4312-b739-13ae34b5c62f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Image limits 0:0:0 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 16 14:30:21.712286 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-8b317f63-3403-4312-b739-13ae34b5c62f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Flavor pref 0:0:0 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 16 14:30:21.712690 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-8b317f63-3403-4312-b739-13ae34b5c62f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Image pref 0:0:0 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 16 14:30:21.713091 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-8b317f63-3403-4312-b739-13ae34b5c62f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 16 14:30:21.722455 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8b317f63-3403-4312-b739-13ae34b5c62f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:21.722926 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8b317f63-3403-4312-b739-13ae34b5c62f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:21.723723 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8b317f63-3403-4312-b739-13ae34b5c62f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:21.724150 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8b317f63-3403-4312-b739-13ae34b5c62f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:21.743333 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.quota [None req-8b317f63-3403-4312-b739-13ae34b5c62f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Getting quotas for project f334385dc44348ac9942c6606482330e. Resources: {'cores', 'instances', 'ram'} {{(pid=117031) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 14:30:21.747163 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.quota [None req-8b317f63-3403-4312-b739-13ae34b5c62f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Getting quotas for user cd0569c12f1740b9a4fab4e6a15f25ed and project f334385dc44348ac9942c6606482330e. Resources: {'cores', 'instances', 'ram'} {{(pid=117031) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 14:30:21.758307 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-8b317f63-3403-4312-b739-13ae34b5c62f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Going to run 1 instances... {{(pid=117031) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 16 14:30:21.760725 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-8b317f63-3403-4312-b739-13ae34b5c62f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f07b0b32-9726-4fef-b3d7-31da2f0ca96f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2493d2dc-e081-43d3-8292-91b4762a21e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 16 14:30:21.772531 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6ca1e03b-659c-47f0-8d5b-3d32927ce556 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:21.790568 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6ca1e03b-659c-47f0-8d5b-3d32927ce556 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:21.795638 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6ca1e03b-659c-47f0-8d5b-3d32927ce556 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:21.795638 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-6ca1e03b-659c-47f0-8d5b-3d32927ce556 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1409 microversion: 2.20 time: 0.184271 Feb 16 14:30:21.795638 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 342/731] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:30:21 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1409 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:30:21.938966 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-8b317f63-3403-4312-b739-13ae34b5c62f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.670525 Feb 16 14:30:21.939834 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 390/732] 10.222.0.110 () {60 vars in 1151 bytes} [Wed Feb 16 14:30:21 2022] POST /compute/v2.1/servers => generated 382 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Feb 16 14:30:21.951334 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-cffd0f41-52df-4b20-a866-dbbf0d4c479d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:21.951940 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-cffd0f41-52df-4b20-a866-dbbf0d4c479d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f07b0b32-9726-4fef-b3d7-31da2f0ca96f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:22.010534 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-cffd0f41-52df-4b20-a866-dbbf0d4c479d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:22.018816 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-cffd0f41-52df-4b20-a866-dbbf0d4c479d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f" status: 200 len: 1222 microversion: 2.1 time: 0.072857 Feb 16 14:30:22.019610 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 343/733] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:21 2022] GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f => generated 1222 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:22.380405 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-18fa174e-8a82-43ee-a350-4708557a8d63 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:22.381016 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-18fa174e-8a82-43ee-a350-4708557a8d63 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:22.387753 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-18fa174e-8a82-43ee-a350-4708557a8d63 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:22.388200 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-18fa174e-8a82-43ee-a350-4708557a8d63 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:22.388988 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-18fa174e-8a82-43ee-a350-4708557a8d63 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:22.389420 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-18fa174e-8a82-43ee-a350-4708557a8d63 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:22.526435 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-18fa174e-8a82-43ee-a350-4708557a8d63 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:22.535726 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-18fa174e-8a82-43ee-a350-4708557a8d63 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1362 microversion: 2.1 time: 0.159346 Feb 16 14:30:22.536627 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 391/734] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:22 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:22.811715 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-8103f38a-5558-4944-8194-ea46f2f85fb3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:22.812328 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-8103f38a-5558-4944-8194-ea46f2f85fb3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:22.818730 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8103f38a-5558-4944-8194-ea46f2f85fb3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:22.819186 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8103f38a-5558-4944-8194-ea46f2f85fb3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:22.819980 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8103f38a-5558-4944-8194-ea46f2f85fb3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:22.820680 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8103f38a-5558-4944-8194-ea46f2f85fb3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:22.959984 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-8103f38a-5558-4944-8194-ea46f2f85fb3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:22.967882 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-8103f38a-5558-4944-8194-ea46f2f85fb3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:22.969406 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-8103f38a-5558-4944-8194-ea46f2f85fb3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:22.970517 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-8103f38a-5558-4944-8194-ea46f2f85fb3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1409 microversion: 2.20 time: 0.162599 Feb 16 14:30:22.971127 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 344/735] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:30:22 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1409 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:30:23.034989 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-a21f7db7-7b86-4478-811e-51d99a6143b2 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:23.035593 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-a21f7db7-7b86-4478-811e-51d99a6143b2 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f07b0b32-9726-4fef-b3d7-31da2f0ca96f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:23.042416 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a21f7db7-7b86-4478-811e-51d99a6143b2 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:23.042881 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a21f7db7-7b86-4478-811e-51d99a6143b2 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:23.043647 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a21f7db7-7b86-4478-811e-51d99a6143b2 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:23.044075 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a21f7db7-7b86-4478-811e-51d99a6143b2 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:23.102405 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-a21f7db7-7b86-4478-811e-51d99a6143b2 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:23.109618 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-a21f7db7-7b86-4478-811e-51d99a6143b2 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f" status: 200 len: 1226 microversion: 2.1 time: 0.078345 Feb 16 14:30:23.110186 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 392/736] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:23 2022] GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f => generated 1226 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:23.481304 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-23dcf680-1671-4f4f-b8da-64069a346db5 req-86c2c4da-c85e-4a33-b7aa-f8ade75b3004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6354a804-6aae-4208-8eb6-6b821ac0ecde", "name": "network-vif-plugged", "status": "completed", "tag": "5ee4e35f-3743-4549-89fe-13d02ed7b538"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:30:23.482922 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:30:23.482922 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: warnings.warn(msg) Feb 16 14:30:23.490370 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-23dcf680-1671-4f4f-b8da-64069a346db5 req-86c2c4da-c85e-4a33-b7aa-f8ade75b3004 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:23.490857 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-23dcf680-1671-4f4f-b8da-64069a346db5 req-86c2c4da-c85e-4a33-b7aa-f8ade75b3004 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:23.502565 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-23dcf680-1671-4f4f-b8da-64069a346db5 req-86c2c4da-c85e-4a33-b7aa-f8ade75b3004 service nova] Creating event network-vif-plugged:5ee4e35f-3743-4549-89fe-13d02ed7b538 for instance 6354a804-6aae-4208-8eb6-6b821ac0ecde on hv-cinder-80473 Feb 16 14:30:23.509249 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-23dcf680-1671-4f4f-b8da-64069a346db5 req-86c2c4da-c85e-4a33-b7aa-f8ade75b3004 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031665 Feb 16 14:30:23.509919 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 345/737] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:30:23.551604 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-30f8b69c-b2f4-4223-9f21-79943ef9f1d6 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:23.552205 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-30f8b69c-b2f4-4223-9f21-79943ef9f1d6 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:23.558643 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-30f8b69c-b2f4-4223-9f21-79943ef9f1d6 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:23.559523 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-30f8b69c-b2f4-4223-9f21-79943ef9f1d6 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:23.560302 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-30f8b69c-b2f4-4223-9f21-79943ef9f1d6 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:23.560733 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-30f8b69c-b2f4-4223-9f21-79943ef9f1d6 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:23.705367 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-30f8b69c-b2f4-4223-9f21-79943ef9f1d6 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:23.714050 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-30f8b69c-b2f4-4223-9f21-79943ef9f1d6 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1362 microversion: 2.1 time: 0.165957 Feb 16 14:30:23.714652 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 393/738] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:23 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:23.989808 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f6f692a3-b252-4f70-86d1-76a2cafac935 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:23.990404 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f6f692a3-b252-4f70-86d1-76a2cafac935 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:23.997601 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f6f692a3-b252-4f70-86d1-76a2cafac935 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:23.998066 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f6f692a3-b252-4f70-86d1-76a2cafac935 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:23.998979 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f6f692a3-b252-4f70-86d1-76a2cafac935 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:23.999414 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f6f692a3-b252-4f70-86d1-76a2cafac935 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:24.126096 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-6be8b4d8-d874-4acc-9064-cae0a605709d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:24.126792 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-6be8b4d8-d874-4acc-9064-cae0a605709d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f07b0b32-9726-4fef-b3d7-31da2f0ca96f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:24.133266 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-6be8b4d8-d874-4acc-9064-cae0a605709d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:24.133492 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-6be8b4d8-d874-4acc-9064-cae0a605709d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:24.134451 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-6be8b4d8-d874-4acc-9064-cae0a605709d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:24.134909 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-6be8b4d8-d874-4acc-9064-cae0a605709d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:24.145327 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f6f692a3-b252-4f70-86d1-76a2cafac935 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:24.154094 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f6f692a3-b252-4f70-86d1-76a2cafac935 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:24.155658 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f6f692a3-b252-4f70-86d1-76a2cafac935 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:24.156778 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f6f692a3-b252-4f70-86d1-76a2cafac935 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1409 microversion: 2.20 time: 0.171483 Feb 16 14:30:24.157354 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 346/739] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:30:23 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1409 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:30:24.195753 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-6be8b4d8-d874-4acc-9064-cae0a605709d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:24.203067 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-6be8b4d8-d874-4acc-9064-cae0a605709d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f" status: 200 len: 1274 microversion: 2.1 time: 0.080478 Feb 16 14:30:24.203627 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 394/740] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:24 2022] GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f => generated 1274 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:30:24.731405 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-3d397dfa-e3d0-4984-a4bf-1b4497fce901 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:24.732060 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-3d397dfa-e3d0-4984-a4bf-1b4497fce901 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:24.737930 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3d397dfa-e3d0-4984-a4bf-1b4497fce901 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:24.738390 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3d397dfa-e3d0-4984-a4bf-1b4497fce901 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:24.739249 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3d397dfa-e3d0-4984-a4bf-1b4497fce901 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:24.739696 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3d397dfa-e3d0-4984-a4bf-1b4497fce901 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:24.882219 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3d397dfa-e3d0-4984-a4bf-1b4497fce901 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:24.889944 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-3d397dfa-e3d0-4984-a4bf-1b4497fce901 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1362 microversion: 2.1 time: 0.162319 Feb 16 14:30:24.890716 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 347/741] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:24 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:25.174908 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-bbd31106-0d19-4122-aed4-b190c2ff31ac tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:25.175619 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-bbd31106-0d19-4122-aed4-b190c2ff31ac tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:25.182307 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-bbd31106-0d19-4122-aed4-b190c2ff31ac tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:25.182799 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-bbd31106-0d19-4122-aed4-b190c2ff31ac tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:25.185270 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-bbd31106-0d19-4122-aed4-b190c2ff31ac tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:25.185743 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-bbd31106-0d19-4122-aed4-b190c2ff31ac tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:25.220323 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-40a82db4-8a92-4d5d-b99f-2cfcb0e4d495 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:25.220978 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-40a82db4-8a92-4d5d-b99f-2cfcb0e4d495 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f07b0b32-9726-4fef-b3d7-31da2f0ca96f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:25.228355 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-40a82db4-8a92-4d5d-b99f-2cfcb0e4d495 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:25.229248 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-40a82db4-8a92-4d5d-b99f-2cfcb0e4d495 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:25.230174 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-40a82db4-8a92-4d5d-b99f-2cfcb0e4d495 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:25.230860 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-40a82db4-8a92-4d5d-b99f-2cfcb0e4d495 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:25.308152 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-40a82db4-8a92-4d5d-b99f-2cfcb0e4d495 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:25.319357 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-40a82db4-8a92-4d5d-b99f-2cfcb0e4d495 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f" status: 200 len: 1282 microversion: 2.1 time: 0.103070 Feb 16 14:30:25.320481 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 348/742] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:25 2022] GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f => generated 1282 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:30:25.331829 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-bbd31106-0d19-4122-aed4-b190c2ff31ac tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:25.340488 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-bbd31106-0d19-4122-aed4-b190c2ff31ac tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:25.341976 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-bbd31106-0d19-4122-aed4-b190c2ff31ac tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:25.343121 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-bbd31106-0d19-4122-aed4-b190c2ff31ac tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1409 microversion: 2.20 time: 0.172122 Feb 16 14:30:25.343676 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 395/743] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:30:25 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1409 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:30:25.907811 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6fe9066f-8f32-4232-b8b7-bf18053c798b tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:25.908426 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-6fe9066f-8f32-4232-b8b7-bf18053c798b tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:25.915460 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6fe9066f-8f32-4232-b8b7-bf18053c798b tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:25.916345 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6fe9066f-8f32-4232-b8b7-bf18053c798b tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:25.916831 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6fe9066f-8f32-4232-b8b7-bf18053c798b tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:25.917179 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6fe9066f-8f32-4232-b8b7-bf18053c798b tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:26.086914 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6fe9066f-8f32-4232-b8b7-bf18053c798b tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:26.097380 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-6fe9066f-8f32-4232-b8b7-bf18053c798b tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1551 microversion: 2.1 time: 0.193270 Feb 16 14:30:26.103502 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 349/744] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:25 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1551 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:26.120763 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-ee378df7-49dc-43d1-96b2-4aefdb33f791 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:26.120763 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-ee378df7-49dc-43d1-96b2-4aefdb33f791 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:26.128939 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ee378df7-49dc-43d1-96b2-4aefdb33f791 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:26.129402 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ee378df7-49dc-43d1-96b2-4aefdb33f791 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:26.135358 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ee378df7-49dc-43d1-96b2-4aefdb33f791 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:26.135358 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ee378df7-49dc-43d1-96b2-4aefdb33f791 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:26.275467 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-ee378df7-49dc-43d1-96b2-4aefdb33f791 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:26.283065 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-ee378df7-49dc-43d1-96b2-4aefdb33f791 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1551 microversion: 2.1 time: 0.167575 Feb 16 14:30:26.283645 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 396/745] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:26 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1551 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:26.298551 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-9e0f227e-d2ca-4224-8fff-b74e3e1d44b7 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:26.302878 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:30:26.302878 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: warnings.warn(msg) Feb 16 14:30:26.305212 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-9e0f227e-d2ca-4224-8fff-b74e3e1d44b7 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:26.305982 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-9e0f227e-d2ca-4224-8fff-b74e3e1d44b7 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Searching by: {'deleted': False, 'project_id': '65654470458446859230c6803abfa3ba'} {{(pid=117032) get_all /opt/stack/nova/nova/compute/api.py:2907}} Feb 16 14:30:26.314013 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9e0f227e-d2ca-4224-8fff-b74e3e1d44b7 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:26.314472 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9e0f227e-d2ca-4224-8fff-b74e3e1d44b7 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:26.315314 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9e0f227e-d2ca-4224-8fff-b74e3e1d44b7 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:26.316274 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9e0f227e-d2ca-4224-8fff-b74e3e1d44b7 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:26.338572 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-8a8e5bb4-a063-4c02-a022-43f772ff1e39 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:26.339671 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-8a8e5bb4-a063-4c02-a022-43f772ff1e39 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f07b0b32-9726-4fef-b3d7-31da2f0ca96f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:26.352522 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8a8e5bb4-a063-4c02-a022-43f772ff1e39 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:26.354906 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8a8e5bb4-a063-4c02-a022-43f772ff1e39 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:26.356869 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8a8e5bb4-a063-4c02-a022-43f772ff1e39 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:26.358431 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8a8e5bb4-a063-4c02-a022-43f772ff1e39 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:26.420349 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.multi_cell_list [None req-9e0f227e-d2ca-4224-8fff-b74e3e1d44b7 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117032) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Feb 16 14:30:26.537742 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-9e0f227e-d2ca-4224-8fff-b74e3e1d44b7 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.242742 Feb 16 14:30:26.539168 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 350/746] 10.222.0.110 () {58 vars in 1129 bytes} [Wed Feb 16 14:30:26 2022] GET /compute/v2.1/servers => generated 344 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:30:26.543648 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a8ad6b81-27d6-43e6-b9ed-8b1ad1bfe282 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:26.544470 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a8ad6b81-27d6-43e6-b9ed-8b1ad1bfe282 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:26.545158 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-8a8e5bb4-a063-4c02-a022-43f772ff1e39 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:26.551878 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a8ad6b81-27d6-43e6-b9ed-8b1ad1bfe282 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:26.552534 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a8ad6b81-27d6-43e6-b9ed-8b1ad1bfe282 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:26.553764 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a8ad6b81-27d6-43e6-b9ed-8b1ad1bfe282 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:26.555091 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a8ad6b81-27d6-43e6-b9ed-8b1ad1bfe282 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:26.555657 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-8a8e5bb4-a063-4c02-a022-43f772ff1e39 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f" status: 200 len: 1322 microversion: 2.1 time: 0.220594 Feb 16 14:30:26.556416 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 397/747] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:26 2022] GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:30:26.561321 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-b20c39fa-83d5-4da3-bba5-35d399980320 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:26.561948 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-b20c39fa-83d5-4da3-bba5-35d399980320 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:26.567756 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b20c39fa-83d5-4da3-bba5-35d399980320 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:26.568253 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b20c39fa-83d5-4da3-bba5-35d399980320 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:26.569265 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b20c39fa-83d5-4da3-bba5-35d399980320 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:26.569833 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b20c39fa-83d5-4da3-bba5-35d399980320 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:26.739084 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-b20c39fa-83d5-4da3-bba5-35d399980320 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:26.753285 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-b20c39fa-83d5-4da3-bba5-35d399980320 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1551 microversion: 2.1 time: 0.193625 Feb 16 14:30:26.754676 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 398/748] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:26 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1551 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:26.955082 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a8ad6b81-27d6-43e6-b9ed-8b1ad1bfe282 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:26.965333 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a8ad6b81-27d6-43e6-b9ed-8b1ad1bfe282 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:26.966804 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a8ad6b81-27d6-43e6-b9ed-8b1ad1bfe282 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:26.967919 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a8ad6b81-27d6-43e6-b9ed-8b1ad1bfe282 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1409 microversion: 2.20 time: 0.427778 Feb 16 14:30:26.968690 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 351/749] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:30:26 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1409 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:30:27.123709 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-89cbacf2-7ff3-4cf7-9c8e-a3f7f9d5a5f4 req-b045d940-0af6-432b-9a63-e64d0570d063 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f07b0b32-9726-4fef-b3d7-31da2f0ca96f", "tag": "e397d52b-5ec8-4dbd-ab87-9d0b217f7995"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:30:27.126276 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:30:27.126276 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:30:27.139825 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-89cbacf2-7ff3-4cf7-9c8e-a3f7f9d5a5f4 req-b045d940-0af6-432b-9a63-e64d0570d063 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:27.140270 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-89cbacf2-7ff3-4cf7-9c8e-a3f7f9d5a5f4 req-b045d940-0af6-432b-9a63-e64d0570d063 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:27.152164 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-89cbacf2-7ff3-4cf7-9c8e-a3f7f9d5a5f4 req-b045d940-0af6-432b-9a63-e64d0570d063 service nova] Creating event network-changed:e397d52b-5ec8-4dbd-ab87-9d0b217f7995 for instance f07b0b32-9726-4fef-b3d7-31da2f0ca96f on hv-cinder-80473 Feb 16 14:30:27.160326 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-89cbacf2-7ff3-4cf7-9c8e-a3f7f9d5a5f4 req-b045d940-0af6-432b-9a63-e64d0570d063 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037579 Feb 16 14:30:27.160326 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 399/750] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:30:27.572428 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e8c97a92-d13f-4cd0-bd2d-cbabe769101b tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:27.573043 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-e8c97a92-d13f-4cd0-bd2d-cbabe769101b tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f07b0b32-9726-4fef-b3d7-31da2f0ca96f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:27.579767 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e8c97a92-d13f-4cd0-bd2d-cbabe769101b tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:27.580229 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e8c97a92-d13f-4cd0-bd2d-cbabe769101b tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:27.581015 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e8c97a92-d13f-4cd0-bd2d-cbabe769101b tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:27.581457 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e8c97a92-d13f-4cd0-bd2d-cbabe769101b tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:27.986739 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-a38dc545-1ec7-4e8a-9bc2-c532ec59622a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:27.987523 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-a38dc545-1ec7-4e8a-9bc2-c532ec59622a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:28.003313 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a38dc545-1ec7-4e8a-9bc2-c532ec59622a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:28.003758 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a38dc545-1ec7-4e8a-9bc2-c532ec59622a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:28.004718 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a38dc545-1ec7-4e8a-9bc2-c532ec59622a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:28.005300 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a38dc545-1ec7-4e8a-9bc2-c532ec59622a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:28.065900 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-e8c97a92-d13f-4cd0-bd2d-cbabe769101b tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:28.076167 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-e8c97a92-d13f-4cd0-bd2d-cbabe769101b tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f" status: 200 len: 1322 microversion: 2.1 time: 0.507539 Feb 16 14:30:28.076752 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 352/751] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:27 2022] GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f => generated 1322 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:28.173212 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-a38dc545-1ec7-4e8a-9bc2-c532ec59622a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:28.182868 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-a38dc545-1ec7-4e8a-9bc2-c532ec59622a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:28.184578 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-a38dc545-1ec7-4e8a-9bc2-c532ec59622a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:28.186106 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-a38dc545-1ec7-4e8a-9bc2-c532ec59622a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1409 microversion: 2.20 time: 0.203524 Feb 16 14:30:28.187315 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 400/752] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:30:27 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1409 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:30:28.599547 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-98dfb540-2bb8-4376-a7aa-b12f5e8bc9c5 req-6962e633-79f3-4f62-9643-6e787f086dda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "542bf2d6-2c49-48e1-a903-3a14bcfb1b0d", "name": "network-vif-plugged", "status": "completed", "tag": "c35750d8-fe77-4744-8fd1-c9914d7c2435"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:30:28.601148 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:30:28.601148 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: warnings.warn(msg) Feb 16 14:30:28.611910 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-98dfb540-2bb8-4376-a7aa-b12f5e8bc9c5 req-6962e633-79f3-4f62-9643-6e787f086dda service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:28.614598 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-98dfb540-2bb8-4376-a7aa-b12f5e8bc9c5 req-6962e633-79f3-4f62-9643-6e787f086dda service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:28.625061 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-98dfb540-2bb8-4376-a7aa-b12f5e8bc9c5 req-6962e633-79f3-4f62-9643-6e787f086dda service nova] Creating event network-vif-plugged:c35750d8-fe77-4744-8fd1-c9914d7c2435 for instance 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d on hv-cinder-80473 Feb 16 14:30:28.631513 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-98dfb540-2bb8-4376-a7aa-b12f5e8bc9c5 req-6962e633-79f3-4f62-9643-6e787f086dda service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035206 Feb 16 14:30:28.634363 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 353/753] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 14:30:28.787447 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-32e4dc37-d0de-47fc-a705-d60293a63610 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1df89e3b-f043-4746-95a0-803f8de83ee0"}} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:30:28.788457 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-32e4dc37-d0de-47fc-a705-d60293a63610 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:28.794741 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-32e4dc37-d0de-47fc-a705-d60293a63610 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:28.795192 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-32e4dc37-d0de-47fc-a705-d60293a63610 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:28.795989 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-32e4dc37-d0de-47fc-a705-d60293a63610 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:28.796427 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-32e4dc37-d0de-47fc-a705-d60293a63610 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:29.093244 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-589e6d2f-6486-4ae0-982f-86e8588bde9d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:29.093974 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-589e6d2f-6486-4ae0-982f-86e8588bde9d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f07b0b32-9726-4fef-b3d7-31da2f0ca96f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:29.100259 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-589e6d2f-6486-4ae0-982f-86e8588bde9d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:29.100997 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-589e6d2f-6486-4ae0-982f-86e8588bde9d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:29.102177 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-589e6d2f-6486-4ae0-982f-86e8588bde9d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:29.102614 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-589e6d2f-6486-4ae0-982f-86e8588bde9d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:29.252240 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-589e6d2f-6486-4ae0-982f-86e8588bde9d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:29.260183 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-589e6d2f-6486-4ae0-982f-86e8588bde9d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f" status: 200 len: 1322 microversion: 2.1 time: 0.171138 Feb 16 14:30:29.260761 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 354/754] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:29 2022] GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:30:29.265032 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a627014f-f5e7-4cf5-ae59-51f5e758d858 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:29.270427 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a627014f-f5e7-4cf5-ae59-51f5e758d858 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:29.271065 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a627014f-f5e7-4cf5-ae59-51f5e758d858 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:29.271519 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a627014f-f5e7-4cf5-ae59-51f5e758d858 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:29.272291 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a627014f-f5e7-4cf5-ae59-51f5e758d858 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:29.272725 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a627014f-f5e7-4cf5-ae59-51f5e758d858 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:29.409146 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a627014f-f5e7-4cf5-ae59-51f5e758d858 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:29.416844 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a627014f-f5e7-4cf5-ae59-51f5e758d858 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:29.418335 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a627014f-f5e7-4cf5-ae59-51f5e758d858 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:29.419440 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a627014f-f5e7-4cf5-ae59-51f5e758d858 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1409 microversion: 2.20 time: 0.157773 Feb 16 14:30:29.420001 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 355/755] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:30:29 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1409 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:30:29.571955 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-32e4dc37-d0de-47fc-a705-d60293a63610 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "POST /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.788339 Feb 16 14:30:29.572702 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 401/756] 10.222.0.110 () {60 vars in 1327 bytes} [Wed Feb 16 14:30:28 2022] POST /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde/os-volume_attachments => generated 194 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 14:30:30.276756 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-172777e0-2811-40d5-99f9-73d49ee6221d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:30.278851 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-172777e0-2811-40d5-99f9-73d49ee6221d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f07b0b32-9726-4fef-b3d7-31da2f0ca96f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:30.283840 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-172777e0-2811-40d5-99f9-73d49ee6221d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:30.284293 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-172777e0-2811-40d5-99f9-73d49ee6221d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:30.285124 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-172777e0-2811-40d5-99f9-73d49ee6221d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:30.285564 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-172777e0-2811-40d5-99f9-73d49ee6221d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:30.420044 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-172777e0-2811-40d5-99f9-73d49ee6221d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:30.427394 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-172777e0-2811-40d5-99f9-73d49ee6221d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f" status: 200 len: 1322 microversion: 2.1 time: 0.154879 Feb 16 14:30:30.427962 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 356/757] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:30 2022] GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:30.438513 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-8bdd7f82-0fd4-46d4-b7f8-9e5661b59339 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:30.439405 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-8bdd7f82-0fd4-46d4-b7f8-9e5661b59339 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:30.446114 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8bdd7f82-0fd4-46d4-b7f8-9e5661b59339 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:30.446583 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8bdd7f82-0fd4-46d4-b7f8-9e5661b59339 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:30.447421 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8bdd7f82-0fd4-46d4-b7f8-9e5661b59339 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:30.447852 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8bdd7f82-0fd4-46d4-b7f8-9e5661b59339 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:30.588336 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-8bdd7f82-0fd4-46d4-b7f8-9e5661b59339 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:30.596314 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-8bdd7f82-0fd4-46d4-b7f8-9e5661b59339 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:30.597820 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-8bdd7f82-0fd4-46d4-b7f8-9e5661b59339 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:30.598988 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-8bdd7f82-0fd4-46d4-b7f8-9e5661b59339 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1409 microversion: 2.20 time: 0.165512 Feb 16 14:30:30.599548 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 402/758] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:30:30 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1409 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:30:31.443565 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ad7b1559-2ea6-4c10-856e-cdc6fb4bc313 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:31.444180 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ad7b1559-2ea6-4c10-856e-cdc6fb4bc313 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f07b0b32-9726-4fef-b3d7-31da2f0ca96f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:31.451402 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ad7b1559-2ea6-4c10-856e-cdc6fb4bc313 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:31.451857 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ad7b1559-2ea6-4c10-856e-cdc6fb4bc313 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:31.452641 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ad7b1559-2ea6-4c10-856e-cdc6fb4bc313 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:31.453346 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ad7b1559-2ea6-4c10-856e-cdc6fb4bc313 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:31.588334 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ad7b1559-2ea6-4c10-856e-cdc6fb4bc313 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:31.595704 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ad7b1559-2ea6-4c10-856e-cdc6fb4bc313 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f" status: 200 len: 1322 microversion: 2.1 time: 0.155935 Feb 16 14:30:31.596271 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 357/759] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:31 2022] GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:31.617906 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-709103e4-4e0f-4dd1-94d3-b9517ecdf6c1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:31.618513 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-709103e4-4e0f-4dd1-94d3-b9517ecdf6c1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:31.625128 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-709103e4-4e0f-4dd1-94d3-b9517ecdf6c1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:31.625658 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-709103e4-4e0f-4dd1-94d3-b9517ecdf6c1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:31.626460 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-709103e4-4e0f-4dd1-94d3-b9517ecdf6c1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:31.626944 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-709103e4-4e0f-4dd1-94d3-b9517ecdf6c1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:31.772673 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-709103e4-4e0f-4dd1-94d3-b9517ecdf6c1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:31.780844 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-709103e4-4e0f-4dd1-94d3-b9517ecdf6c1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:31.782358 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-709103e4-4e0f-4dd1-94d3-b9517ecdf6c1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:31.783575 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-709103e4-4e0f-4dd1-94d3-b9517ecdf6c1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1600 microversion: 2.20 time: 0.170175 Feb 16 14:30:31.784158 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 403/760] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:30:31 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1600 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:30:31.801732 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-54b11f94-2df8-4f80-8601-b32290abd21f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:31.802158 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-54b11f94-2df8-4f80-8601-b32290abd21f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:31.808585 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-54b11f94-2df8-4f80-8601-b32290abd21f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:31.809037 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-54b11f94-2df8-4f80-8601-b32290abd21f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:31.809816 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-54b11f94-2df8-4f80-8601-b32290abd21f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:31.810256 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-54b11f94-2df8-4f80-8601-b32290abd21f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:31.891245 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-54b11f94-2df8-4f80-8601-b32290abd21f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093298 Feb 16 14:30:31.891849 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 358/761] 10.222.0.110 () {60 vars in 1320 bytes} [Wed Feb 16 14:30:31 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 16 14:30:32.612795 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-99e0b692-4d32-46fd-8295-e7e1682c95e4 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:32.613416 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-99e0b692-4d32-46fd-8295-e7e1682c95e4 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f07b0b32-9726-4fef-b3d7-31da2f0ca96f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:32.619479 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-99e0b692-4d32-46fd-8295-e7e1682c95e4 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:32.620088 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-99e0b692-4d32-46fd-8295-e7e1682c95e4 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:32.620710 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-99e0b692-4d32-46fd-8295-e7e1682c95e4 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:32.621148 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-99e0b692-4d32-46fd-8295-e7e1682c95e4 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:32.776952 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-99e0b692-4d32-46fd-8295-e7e1682c95e4 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:32.787831 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-99e0b692-4d32-46fd-8295-e7e1682c95e4 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f" status: 200 len: 1322 microversion: 2.1 time: 0.178736 Feb 16 14:30:32.789360 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 404/762] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:32 2022] GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:32.981571 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ffcd8860-726a-48e4-906c-65dc342b7895 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:32.982155 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ffcd8860-726a-48e4-906c-65dc342b7895 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:32.984143 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-d41d080e-a9a6-4de9-8ff2-2b8591c315c1 req-76180823-3a19-4329-b624-b7b093a8f17a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "542bf2d6-2c49-48e1-a903-3a14bcfb1b0d", "tag": "c35750d8-fe77-4744-8fd1-c9914d7c2435"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:30:32.985715 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:30:32.985715 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:30:32.988850 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ffcd8860-726a-48e4-906c-65dc342b7895 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:32.989552 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ffcd8860-726a-48e4-906c-65dc342b7895 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:32.990424 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ffcd8860-726a-48e4-906c-65dc342b7895 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:32.990981 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ffcd8860-726a-48e4-906c-65dc342b7895 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:32.992830 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-d41d080e-a9a6-4de9-8ff2-2b8591c315c1 req-76180823-3a19-4329-b624-b7b093a8f17a service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:32.993460 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-d41d080e-a9a6-4de9-8ff2-2b8591c315c1 req-76180823-3a19-4329-b624-b7b093a8f17a service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:33.007010 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-d41d080e-a9a6-4de9-8ff2-2b8591c315c1 req-76180823-3a19-4329-b624-b7b093a8f17a service nova] Creating event network-changed:c35750d8-fe77-4744-8fd1-c9914d7c2435 for instance 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d on hv-cinder-80473 Feb 16 14:30:33.012522 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-d41d080e-a9a6-4de9-8ff2-2b8591c315c1 req-76180823-3a19-4329-b624-b7b093a8f17a service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032439 Feb 16 14:30:33.013546 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 405/763] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 14:30:33.016138 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ffcd8860-726a-48e4-906c-65dc342b7895 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d/ips" status: 200 len: 111 microversion: 2.20 time: 0.040005 Feb 16 14:30:33.017067 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 359/764] 10.222.0.110 () {60 vars in 1293 bytes} [Wed Feb 16 14:30:32 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d/ips => generated 111 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Feb 16 14:30:33.805732 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-089aa244-9dc2-4a04-8067-206f99673062 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:33.806446 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-089aa244-9dc2-4a04-8067-206f99673062 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f07b0b32-9726-4fef-b3d7-31da2f0ca96f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:33.813425 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-089aa244-9dc2-4a04-8067-206f99673062 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:33.813885 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-089aa244-9dc2-4a04-8067-206f99673062 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:33.814710 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-089aa244-9dc2-4a04-8067-206f99673062 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:33.815149 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-089aa244-9dc2-4a04-8067-206f99673062 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:33.974129 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-089aa244-9dc2-4a04-8067-206f99673062 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:33.980389 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-089aa244-9dc2-4a04-8067-206f99673062 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f" status: 200 len: 1322 microversion: 2.1 time: 0.179347 Feb 16 14:30:33.981271 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 406/765] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:33 2022] GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:34.997157 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6cae199c-3a8a-4ca1-bde1-e305e148dde9 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:34.997799 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-6cae199c-3a8a-4ca1-bde1-e305e148dde9 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f07b0b32-9726-4fef-b3d7-31da2f0ca96f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:35.004103 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6cae199c-3a8a-4ca1-bde1-e305e148dde9 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:35.004550 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6cae199c-3a8a-4ca1-bde1-e305e148dde9 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:35.005320 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6cae199c-3a8a-4ca1-bde1-e305e148dde9 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:35.005752 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6cae199c-3a8a-4ca1-bde1-e305e148dde9 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:35.139768 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6cae199c-3a8a-4ca1-bde1-e305e148dde9 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:35.147061 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-6cae199c-3a8a-4ca1-bde1-e305e148dde9 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f" status: 200 len: 1322 microversion: 2.1 time: 0.153543 Feb 16 14:30:35.147646 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 360/766] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:34 2022] GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:36.163356 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-e894e0ab-1fba-4b4a-83c6-1089e34eb31e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:36.164535 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-e894e0ab-1fba-4b4a-83c6-1089e34eb31e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f07b0b32-9726-4fef-b3d7-31da2f0ca96f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:36.170833 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e894e0ab-1fba-4b4a-83c6-1089e34eb31e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:36.171289 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e894e0ab-1fba-4b4a-83c6-1089e34eb31e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:36.175562 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e894e0ab-1fba-4b4a-83c6-1089e34eb31e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:36.175562 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e894e0ab-1fba-4b4a-83c6-1089e34eb31e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:36.307295 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-e894e0ab-1fba-4b4a-83c6-1089e34eb31e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:36.314494 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-e894e0ab-1fba-4b4a-83c6-1089e34eb31e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f" status: 200 len: 1322 microversion: 2.1 time: 0.154744 Feb 16 14:30:36.315095 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 407/767] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:36 2022] GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:30:36.633743 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-1c396a97-177e-4aea-bc7a-71c83c99ae06 req-285366ca-4bcc-42ff-840d-282792fb2ebb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f07b0b32-9726-4fef-b3d7-31da2f0ca96f", "name": "network-vif-plugged", "status": "completed", "tag": "e397d52b-5ec8-4dbd-ab87-9d0b217f7995"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:30:36.635361 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:30:36.635361 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: warnings.warn(msg) Feb 16 14:30:36.643021 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-1c396a97-177e-4aea-bc7a-71c83c99ae06 req-285366ca-4bcc-42ff-840d-282792fb2ebb service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:36.643466 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-1c396a97-177e-4aea-bc7a-71c83c99ae06 req-285366ca-4bcc-42ff-840d-282792fb2ebb service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:36.654415 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-1c396a97-177e-4aea-bc7a-71c83c99ae06 req-285366ca-4bcc-42ff-840d-282792fb2ebb service nova] Creating event network-vif-plugged:e397d52b-5ec8-4dbd-ab87-9d0b217f7995 for instance f07b0b32-9726-4fef-b3d7-31da2f0ca96f on hv-cinder-80473 Feb 16 14:30:36.659712 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-1c396a97-177e-4aea-bc7a-71c83c99ae06 req-285366ca-4bcc-42ff-840d-282792fb2ebb service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030989 Feb 16 14:30:36.662617 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 361/768] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:30:37.333486 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-e34d0869-7406-410f-a4c1-9d062dbd6755 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:37.334085 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-e34d0869-7406-410f-a4c1-9d062dbd6755 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f07b0b32-9726-4fef-b3d7-31da2f0ca96f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:37.340791 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e34d0869-7406-410f-a4c1-9d062dbd6755 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:37.341244 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e34d0869-7406-410f-a4c1-9d062dbd6755 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:37.342028 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e34d0869-7406-410f-a4c1-9d062dbd6755 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:37.342461 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e34d0869-7406-410f-a4c1-9d062dbd6755 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:37.431493 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-daa336ac-54b7-4016-bbfb-0d89a28cf53e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:37.432757 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-daa336ac-54b7-4016-bbfb-0d89a28cf53e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:37.443929 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-daa336ac-54b7-4016-bbfb-0d89a28cf53e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:37.444155 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-daa336ac-54b7-4016-bbfb-0d89a28cf53e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:37.446033 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-daa336ac-54b7-4016-bbfb-0d89a28cf53e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:37.446497 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-daa336ac-54b7-4016-bbfb-0d89a28cf53e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:37.478245 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-daa336ac-54b7-4016-bbfb-0d89a28cf53e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051648 Feb 16 14:30:37.478862 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 362/769] 10.222.0.110 () {58 vars in 1306 bytes} [Wed Feb 16 14:30:37 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 16 14:30:37.519637 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-e34d0869-7406-410f-a4c1-9d062dbd6755 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:37.528147 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-e34d0869-7406-410f-a4c1-9d062dbd6755 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f" status: 200 len: 1322 microversion: 2.1 time: 0.200448 Feb 16 14:30:37.528717 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 408/770] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:37 2022] GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:37.536622 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c2d550ec-c4cf-474e-a598-acbb0b3d9d89 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:37.537160 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c2d550ec-c4cf-474e-a598-acbb0b3d9d89 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:37.544110 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c2d550ec-c4cf-474e-a598-acbb0b3d9d89 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:37.544863 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c2d550ec-c4cf-474e-a598-acbb0b3d9d89 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:37.545745 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c2d550ec-c4cf-474e-a598-acbb0b3d9d89 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:37.546438 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c2d550ec-c4cf-474e-a598-acbb0b3d9d89 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:37.571699 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c2d550ec-c4cf-474e-a598-acbb0b3d9d89 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Going to try to terminate instance {{(pid=117032) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 16 14:30:37.859704 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c2d550ec-c4cf-474e-a598-acbb0b3d9d89 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "DELETE /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 204 len: 0 microversion: 2.1 time: 0.326514 Feb 16 14:30:37.860596 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 363/771] 10.222.0.110 () {58 vars in 1243 bytes} [Wed Feb 16 14:30:37 2022] DELETE /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 16 14:30:37.868590 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-a498f7a7-ec8a-4d51-b312-553483f4a2b5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:37.869202 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-a498f7a7-ec8a-4d51-b312-553483f4a2b5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:37.875030 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a498f7a7-ec8a-4d51-b312-553483f4a2b5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:37.875481 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a498f7a7-ec8a-4d51-b312-553483f4a2b5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:37.876267 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a498f7a7-ec8a-4d51-b312-553483f4a2b5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:37.876701 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a498f7a7-ec8a-4d51-b312-553483f4a2b5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:38.020507 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-a498f7a7-ec8a-4d51-b312-553483f4a2b5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:38.028619 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-a498f7a7-ec8a-4d51-b312-553483f4a2b5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1675 microversion: 2.1 time: 0.163802 Feb 16 14:30:38.029236 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 409/772] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:37 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:38.160643 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-48ef76cf-45d2-43e4-960c-ba96dacd9520 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:38.161356 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-48ef76cf-45d2-43e4-960c-ba96dacd9520 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:38.167834 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-48ef76cf-45d2-43e4-960c-ba96dacd9520 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:38.168308 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-48ef76cf-45d2-43e4-960c-ba96dacd9520 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:38.169427 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-48ef76cf-45d2-43e4-960c-ba96dacd9520 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:38.169867 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-48ef76cf-45d2-43e4-960c-ba96dacd9520 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:38.312223 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-48ef76cf-45d2-43e4-960c-ba96dacd9520 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:38.320174 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-48ef76cf-45d2-43e4-960c-ba96dacd9520 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1597 microversion: 2.1 time: 0.164541 Feb 16 14:30:38.320752 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 364/773] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:38 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1597 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:38.544730 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-af24580f-1cc9-498e-a5bc-08fbe488dd57 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:38.545336 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-af24580f-1cc9-498e-a5bc-08fbe488dd57 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f07b0b32-9726-4fef-b3d7-31da2f0ca96f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:38.551619 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-af24580f-1cc9-498e-a5bc-08fbe488dd57 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:38.554800 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-af24580f-1cc9-498e-a5bc-08fbe488dd57 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:38.554800 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-af24580f-1cc9-498e-a5bc-08fbe488dd57 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:38.554800 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-af24580f-1cc9-498e-a5bc-08fbe488dd57 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:38.697539 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-af24580f-1cc9-498e-a5bc-08fbe488dd57 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:38.705032 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-af24580f-1cc9-498e-a5bc-08fbe488dd57 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f" status: 200 len: 1322 microversion: 2.1 time: 0.163954 Feb 16 14:30:38.705594 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 410/774] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:38 2022] GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:39.045304 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-748ab9c4-7f05-4ecf-931e-ed54f10876aa tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:39.045896 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-748ab9c4-7f05-4ecf-931e-ed54f10876aa tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:39.052217 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-748ab9c4-7f05-4ecf-931e-ed54f10876aa tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:39.055786 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-748ab9c4-7f05-4ecf-931e-ed54f10876aa tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:39.055786 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-748ab9c4-7f05-4ecf-931e-ed54f10876aa tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:39.055786 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-748ab9c4-7f05-4ecf-931e-ed54f10876aa tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:39.327470 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-748ab9c4-7f05-4ecf-931e-ed54f10876aa tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:39.336619 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-748ab9c4-7f05-4ecf-931e-ed54f10876aa tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1675 microversion: 2.1 time: 0.294987 Feb 16 14:30:39.337488 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 365/775] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:39 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1675 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:39.723035 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-3607a258-6972-408b-af3d-9c4b65b179f1 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:39.723646 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-3607a258-6972-408b-af3d-9c4b65b179f1 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f07b0b32-9726-4fef-b3d7-31da2f0ca96f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:39.730674 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3607a258-6972-408b-af3d-9c4b65b179f1 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:39.732374 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3607a258-6972-408b-af3d-9c4b65b179f1 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:39.732374 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3607a258-6972-408b-af3d-9c4b65b179f1 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:39.732374 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3607a258-6972-408b-af3d-9c4b65b179f1 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:39.870550 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-3607a258-6972-408b-af3d-9c4b65b179f1 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:39.879077 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-3607a258-6972-408b-af3d-9c4b65b179f1 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f" status: 200 len: 1512 microversion: 2.1 time: 0.159657 Feb 16 14:30:39.879803 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 411/776] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:39 2022] GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:40.354551 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-19753495-381f-4f02-905a-4b13923b1d1c tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:40.355193 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-19753495-381f-4f02-905a-4b13923b1d1c tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:40.361918 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-19753495-381f-4f02-905a-4b13923b1d1c tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:40.362376 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-19753495-381f-4f02-905a-4b13923b1d1c tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:40.363201 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-19753495-381f-4f02-905a-4b13923b1d1c tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:40.363647 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-19753495-381f-4f02-905a-4b13923b1d1c tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:40.681497 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-19753495-381f-4f02-905a-4b13923b1d1c tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:40.688912 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-19753495-381f-4f02-905a-4b13923b1d1c tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1675 microversion: 2.1 time: 0.338768 Feb 16 14:30:40.689493 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 366/777] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:40 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1675 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:41.210899 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-416010a7-1208-4d24-b871-bcf9297b9e70 req-786c5719-814b-468b-8fca-7bef4d019133 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6354a804-6aae-4208-8eb6-6b821ac0ecde", "tag": "5ee4e35f-3743-4549-89fe-13d02ed7b538"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:30:41.213337 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:30:41.213337 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:30:41.220907 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-416010a7-1208-4d24-b871-bcf9297b9e70 req-786c5719-814b-468b-8fca-7bef4d019133 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:41.221437 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-416010a7-1208-4d24-b871-bcf9297b9e70 req-786c5719-814b-468b-8fca-7bef4d019133 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:41.233406 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-416010a7-1208-4d24-b871-bcf9297b9e70 req-786c5719-814b-468b-8fca-7bef4d019133 service nova] Creating event network-changed:5ee4e35f-3743-4549-89fe-13d02ed7b538 for instance 6354a804-6aae-4208-8eb6-6b821ac0ecde on hv-cinder-80473 Feb 16 14:30:41.238419 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-416010a7-1208-4d24-b871-bcf9297b9e70 req-786c5719-814b-468b-8fca-7bef4d019133 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152139 Feb 16 14:30:41.239732 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 412/778] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:30:41.705424 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-54ce5965-7104-4461-a28d-6bc4ca070040 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:41.706031 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-54ce5965-7104-4461-a28d-6bc4ca070040 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:41.714831 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-54ce5965-7104-4461-a28d-6bc4ca070040 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:41.715289 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-54ce5965-7104-4461-a28d-6bc4ca070040 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:41.716109 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-54ce5965-7104-4461-a28d-6bc4ca070040 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:41.716529 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-54ce5965-7104-4461-a28d-6bc4ca070040 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:41.866492 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-54ce5965-7104-4461-a28d-6bc4ca070040 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:41.875828 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-54ce5965-7104-4461-a28d-6bc4ca070040 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1675 microversion: 2.1 time: 0.174291 Feb 16 14:30:41.876475 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 367/779] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:41 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1675 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:42.894418 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-67a17127-fd26-4ed9-82d8-a252029b5a9d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:42.898024 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-67a17127-fd26-4ed9-82d8-a252029b5a9d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:42.902377 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-67a17127-fd26-4ed9-82d8-a252029b5a9d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:42.902877 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-67a17127-fd26-4ed9-82d8-a252029b5a9d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:42.903671 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-67a17127-fd26-4ed9-82d8-a252029b5a9d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:42.904126 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-67a17127-fd26-4ed9-82d8-a252029b5a9d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:43.081113 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-67a17127-fd26-4ed9-82d8-a252029b5a9d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:43.089942 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-67a17127-fd26-4ed9-82d8-a252029b5a9d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1675 microversion: 2.1 time: 0.199989 Feb 16 14:30:43.099485 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 413/780] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:42 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1675 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:30:43.750536 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-27cc821d-831e-431e-8a62-470d0cb20d4c tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1639953936"}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:30:43.751089 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-27cc821d-831e-431e-8a62-470d0cb20d4c tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:43.758505 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-27cc821d-831e-431e-8a62-470d0cb20d4c tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:43.759225 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-27cc821d-831e-431e-8a62-470d0cb20d4c tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:43.760033 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-27cc821d-831e-431e-8a62-470d0cb20d4c tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:43.760557 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-27cc821d-831e-431e-8a62-470d0cb20d4c tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:43.901935 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.network.security_group_api [None req-27cc821d-831e-431e-8a62-470d0cb20d4c tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Adding security group d404954e-d10b-4006-b940-7e909456897d to port 5ee4e35f-3743-4549-89fe-13d02ed7b538 Feb 16 14:30:44.109988 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-4b81be9e-cee1-49cc-8a34-b9b343065b38 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:44.110603 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-4b81be9e-cee1-49cc-8a34-b9b343065b38 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:44.119170 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4b81be9e-cee1-49cc-8a34-b9b343065b38 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:44.119631 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4b81be9e-cee1-49cc-8a34-b9b343065b38 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:44.121179 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4b81be9e-cee1-49cc-8a34-b9b343065b38 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:44.121623 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4b81be9e-cee1-49cc-8a34-b9b343065b38 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:44.275963 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-4b81be9e-cee1-49cc-8a34-b9b343065b38 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:44.285335 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-4b81be9e-cee1-49cc-8a34-b9b343065b38 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1675 microversion: 2.1 time: 0.180254 Feb 16 14:30:44.287019 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 414/781] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:44 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1675 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:44.458445 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-27cc821d-831e-431e-8a62-470d0cb20d4c tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "POST /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde/action" status: 202 len: 0 microversion: 2.1 time: 0.710937 Feb 16 14:30:44.459805 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 368/782] 10.222.0.110 () {60 vars in 1282 bytes} [Wed Feb 16 14:30:43 2022] POST /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde/action => generated 0 bytes in 714 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 14:30:44.468599 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-23b2d06b-21f2-413d-aad9-0a5a66de0302 req-012571b8-8e14-4e52-a631-a233c09c07cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6354a804-6aae-4208-8eb6-6b821ac0ecde", "tag": "5ee4e35f-3743-4549-89fe-13d02ed7b538"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:30:44.468992 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c06b84eb-e4a6-434c-836d-3f558b251cb2 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:44.469636 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c06b84eb-e4a6-434c-836d-3f558b251cb2 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:44.470784 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:30:44.470784 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:30:44.480324 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c06b84eb-e4a6-434c-836d-3f558b251cb2 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:44.485948 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c06b84eb-e4a6-434c-836d-3f558b251cb2 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:44.485948 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c06b84eb-e4a6-434c-836d-3f558b251cb2 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:44.485948 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c06b84eb-e4a6-434c-836d-3f558b251cb2 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:44.494901 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-23b2d06b-21f2-413d-aad9-0a5a66de0302 req-012571b8-8e14-4e52-a631-a233c09c07cc service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:44.496152 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-23b2d06b-21f2-413d-aad9-0a5a66de0302 req-012571b8-8e14-4e52-a631-a233c09c07cc service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:44.519540 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-23b2d06b-21f2-413d-aad9-0a5a66de0302 req-012571b8-8e14-4e52-a631-a233c09c07cc service nova] Creating event network-changed:5ee4e35f-3743-4549-89fe-13d02ed7b538 for instance 6354a804-6aae-4208-8eb6-6b821ac0ecde on hv-cinder-80473 Feb 16 14:30:44.527025 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-23b2d06b-21f2-413d-aad9-0a5a66de0302 req-012571b8-8e14-4e52-a631-a233c09c07cc service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063692 Feb 16 14:30:44.527855 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 415/783] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:30:44.743042 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c06b84eb-e4a6-434c-836d-3f558b251cb2 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:44.752766 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c06b84eb-e4a6-434c-836d-3f558b251cb2 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1644 microversion: 2.1 time: 0.287688 Feb 16 14:30:44.754932 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 369/784] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:44 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1644 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:45.305468 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-6c7b5a46-9065-48ae-9fab-2c6919342432 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:45.311600 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-6c7b5a46-9065-48ae-9fab-2c6919342432 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:45.322070 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-6c7b5a46-9065-48ae-9fab-2c6919342432 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:45.322514 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-6c7b5a46-9065-48ae-9fab-2c6919342432 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:45.323390 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-6c7b5a46-9065-48ae-9fab-2c6919342432 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:45.324803 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-6c7b5a46-9065-48ae-9fab-2c6919342432 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:45.507682 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-6c7b5a46-9065-48ae-9fab-2c6919342432 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:45.516046 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-6c7b5a46-9065-48ae-9fab-2c6919342432 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1675 microversion: 2.1 time: 0.214886 Feb 16 14:30:45.516610 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 416/785] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:45 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1675 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:45.849571 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f582c43c-913a-47e4-94de-ff0a576a0145 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c511043-4a4a-469b-a399-34212713cd72"}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:30:45.850726 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f582c43c-913a-47e4-94de-ff0a576a0145 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f07b0b32-9726-4fef-b3d7-31da2f0ca96f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:45.857539 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f582c43c-913a-47e4-94de-ff0a576a0145 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:45.858433 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f582c43c-913a-47e4-94de-ff0a576a0145 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:45.859297 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f582c43c-913a-47e4-94de-ff0a576a0145 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:45.859876 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f582c43c-913a-47e4-94de-ff0a576a0145 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:46.534005 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-07a63032-c49f-4baa-bbb8-59e27ef96525 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:46.535334 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-07a63032-c49f-4baa-bbb8-59e27ef96525 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:46.542808 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-07a63032-c49f-4baa-bbb8-59e27ef96525 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:46.545940 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-07a63032-c49f-4baa-bbb8-59e27ef96525 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:46.545940 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-07a63032-c49f-4baa-bbb8-59e27ef96525 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:46.545940 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-07a63032-c49f-4baa-bbb8-59e27ef96525 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:46.631079 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-07a63032-c49f-4baa-bbb8-59e27ef96525 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:46.647554 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-07a63032-c49f-4baa-bbb8-59e27ef96525 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1608 microversion: 2.1 time: 0.117805 Feb 16 14:30:46.657608 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 417/786] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:46 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1608 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:46.793832 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-0c2e95b0-d4a7-4a33-81b4-dafceb1d2a51 req-ac23f74b-61f3-43b1-aeb1-a48499782878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64a4628d-ace6-4282-948c-d3e154ba9f35", "name": "network-vif-deleted", "tag": "03b4e298-5eed-4639-a433-5b0e77361bac"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:30:46.795461 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:30:46.795461 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:30:46.802438 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-0c2e95b0-d4a7-4a33-81b4-dafceb1d2a51 req-ac23f74b-61f3-43b1-aeb1-a48499782878 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:46.802919 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-0c2e95b0-d4a7-4a33-81b4-dafceb1d2a51 req-ac23f74b-61f3-43b1-aeb1-a48499782878 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:46.814955 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-0c2e95b0-d4a7-4a33-81b4-dafceb1d2a51 req-ac23f74b-61f3-43b1-aeb1-a48499782878 service nova] Creating event network-vif-deleted:03b4e298-5eed-4639-a433-5b0e77361bac for instance 64a4628d-ace6-4282-948c-d3e154ba9f35 on hv-cinder-80473 Feb 16 14:30:46.824413 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-0c2e95b0-d4a7-4a33-81b4-dafceb1d2a51 req-ac23f74b-61f3-43b1-aeb1-a48499782878 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034146 Feb 16 14:30:46.825128 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 418/787] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:30:47.672473 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-7afddb78-5b87-4659-bb81-140856e5c066 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:47.672473 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-7afddb78-5b87-4659-bb81-140856e5c066 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:47.679727 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7afddb78-5b87-4659-bb81-140856e5c066 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:47.680174 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7afddb78-5b87-4659-bb81-140856e5c066 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:47.681647 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7afddb78-5b87-4659-bb81-140856e5c066 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:47.682093 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7afddb78-5b87-4659-bb81-140856e5c066 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:47.751514 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-7afddb78-5b87-4659-bb81-140856e5c066 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:47.760071 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-7afddb78-5b87-4659-bb81-140856e5c066 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1608 microversion: 2.1 time: 0.098321 Feb 16 14:30:47.764388 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 419/788] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:47 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1608 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:48.779756 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-c2e9a66f-4b34-4a1f-9434-d545f549037b tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:48.780384 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-c2e9a66f-4b34-4a1f-9434-d545f549037b tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:48.786814 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c2e9a66f-4b34-4a1f-9434-d545f549037b tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:48.787260 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c2e9a66f-4b34-4a1f-9434-d545f549037b tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:48.788048 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c2e9a66f-4b34-4a1f-9434-d545f549037b tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:48.788503 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c2e9a66f-4b34-4a1f-9434-d545f549037b tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:48.850002 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-c2e9a66f-4b34-4a1f-9434-d545f549037b tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:48.858601 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-c2e9a66f-4b34-4a1f-9434-d545f549037b tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1608 microversion: 2.1 time: 0.082597 Feb 16 14:30:48.859218 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 420/789] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:48 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1608 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:30:49.876159 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-b7e770f8-7796-425d-875d-5625bc919d29 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:49.876808 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-b7e770f8-7796-425d-875d-5625bc919d29 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:49.884333 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b7e770f8-7796-425d-875d-5625bc919d29 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:49.884981 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b7e770f8-7796-425d-875d-5625bc919d29 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:49.885781 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b7e770f8-7796-425d-875d-5625bc919d29 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:49.886215 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b7e770f8-7796-425d-875d-5625bc919d29 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:49.950606 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-b7e770f8-7796-425d-875d-5625bc919d29 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:49.965318 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-b7e770f8-7796-425d-875d-5625bc919d29 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1608 microversion: 2.1 time: 0.092888 Feb 16 14:30:49.965901 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 421/790] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:49 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1608 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:30:50.640413 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f582c43c-913a-47e4-94de-ff0a576a0145 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "POST /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.796725 Feb 16 14:30:50.645647 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 370/791] 10.222.0.110 () {60 vars in 1327 bytes} [Wed Feb 16 14:30:45 2022] POST /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f/os-volume_attachments => generated 194 bytes in 4798 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 14:30:50.983386 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-05ff6bc1-3ce1-4a94-a3de-3fbb39bb05ae tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:50.984650 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-05ff6bc1-3ce1-4a94-a3de-3fbb39bb05ae tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:50.993951 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-05ff6bc1-3ce1-4a94-a3de-3fbb39bb05ae tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:50.994415 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-05ff6bc1-3ce1-4a94-a3de-3fbb39bb05ae tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:50.995579 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-05ff6bc1-3ce1-4a94-a3de-3fbb39bb05ae tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:50.996311 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-05ff6bc1-3ce1-4a94-a3de-3fbb39bb05ae tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:51.036654 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-05ff6bc1-3ce1-4a94-a3de-3fbb39bb05ae tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:51.037102 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-05ff6bc1-3ce1-4a94-a3de-3fbb39bb05ae tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:51.037546 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.objects.instance [None req-05ff6bc1-3ce1-4a94-a3de-3fbb39bb05ae tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lazy-loading 'fault' on Instance uuid 64a4628d-ace6-4282-948c-d3e154ba9f35 {{(pid=117031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:30:51.081821 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-05ff6bc1-3ce1-4a94-a3de-3fbb39bb05ae tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:51.089900 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-05ff6bc1-3ce1-4a94-a3de-3fbb39bb05ae tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 200 len: 1330 microversion: 2.1 time: 0.110342 Feb 16 14:30:51.090475 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 422/792] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:50 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 1330 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:52.111640 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-4b4d6710-dea1-4005-841f-d23aec090cd7 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:52.112374 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-4b4d6710-dea1-4005-841f-d23aec090cd7 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:52.120645 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4b4d6710-dea1-4005-841f-d23aec090cd7 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:52.121100 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4b4d6710-dea1-4005-841f-d23aec090cd7 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:52.121884 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4b4d6710-dea1-4005-841f-d23aec090cd7 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:52.122324 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4b4d6710-dea1-4005-841f-d23aec090cd7 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:52.135765 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-4b4d6710-dea1-4005-841f-d23aec090cd7 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] HTTP exception thrown: Instance 64a4628d-ace6-4282-948c-d3e154ba9f35 could not be found. Feb 16 14:30:52.136373 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-4b4d6710-dea1-4005-841f-d23aec090cd7 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Returning 404 to user: Instance 64a4628d-ace6-4282-948c-d3e154ba9f35 could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:30:52.137263 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-4b4d6710-dea1-4005-841f-d23aec090cd7 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 404 len: 111 microversion: 2.1 time: 0.030130 Feb 16 14:30:52.137992 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 371/793] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:52 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 14:30:52.145911 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-9b05e0ae-b304-41b9-8cc0-1b19a09e1257 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '.version_select at 0x7f2990ee4040>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:52.243477 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-9b05e0ae-b304-41b9-8cc0-1b19a09e1257 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-74248194" status: 202 len: 0 microversion: 2.1 time: 0.100600 Feb 16 14:30:52.244051 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 423/794] 10.222.0.110 () {58 vars in 1219 bytes} [Wed Feb 16 14:30:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-74248194 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 14:30:53.001159 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6dae6ce0-8a9c-48ad-9fbd-6897e63eb7b2 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Action: 'create', calling method: .version_select at 0x7f2990c93ca0>, body: {"keypair": {"name": "tempest-keypair-1396104879"}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:30:53.015574 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-6dae6ce0-8a9c-48ad-9fbd-6897e63eb7b2 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Getting quotas for project d48b56501b0a49829c4522b171dd1159. Resources: {'key_pairs'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 14:30:53.019469 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-6dae6ce0-8a9c-48ad-9fbd-6897e63eb7b2 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Getting quotas for user bdbb57cd56c5450aacce437150585ea0 and project d48b56501b0a49829c4522b171dd1159. Resources: {'key_pairs'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 14:30:53.174293 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-6dae6ce0-8a9c-48ad-9fbd-6897e63eb7b2 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Getting quotas for project d48b56501b0a49829c4522b171dd1159. Resources: {'key_pairs'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 14:30:53.178096 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-6dae6ce0-8a9c-48ad-9fbd-6897e63eb7b2 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Getting quotas for user bdbb57cd56c5450aacce437150585ea0 and project d48b56501b0a49829c4522b171dd1159. Resources: {'key_pairs'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 14:30:53.191069 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-6dae6ce0-8a9c-48ad-9fbd-6897e63eb7b2 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.193843 Feb 16 14:30:53.191652 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 372/795] 10.222.0.110 () {60 vars in 1162 bytes} [Wed Feb 16 14:30:52 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:30:55.248700 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-8802fc17-69c8-4e56-82e4-07da9e8925ff tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-648589947", "imageRef": "2493d2dc-e081-43d3-8292-91b4762a21e8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d94143be-8ba2-454c-8d39-3ad4b5796d55"}], "security_groups": [{"name": "tempest-securitygroup--1604142984"}], "key_name": "tempest-keypair-1396104879", "user_data": "}} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:30:55.348920 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.network.neutron [None req-8802fc17-69c8-4e56-82e4-07da9e8925ff tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] validate_networks() for [('d94143be-8ba2-454c-8d39-3ad4b5796d55', None, None, None, None, None)] {{(pid=117031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 16 14:30:55.770488 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-8802fc17-69c8-4e56-82e4-07da9e8925ff tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Flavor limits 0:0:0 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 16 14:30:55.770933 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-8802fc17-69c8-4e56-82e4-07da9e8925ff tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Image limits 0:0:0 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 16 14:30:55.771401 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-8802fc17-69c8-4e56-82e4-07da9e8925ff tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Flavor pref 0:0:0 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 16 14:30:55.771817 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-8802fc17-69c8-4e56-82e4-07da9e8925ff tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Image pref 0:0:0 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 16 14:30:55.772223 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-8802fc17-69c8-4e56-82e4-07da9e8925ff tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 16 14:30:55.780778 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8802fc17-69c8-4e56-82e4-07da9e8925ff tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:55.781218 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8802fc17-69c8-4e56-82e4-07da9e8925ff tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:55.782012 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8802fc17-69c8-4e56-82e4-07da9e8925ff tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:55.782438 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8802fc17-69c8-4e56-82e4-07da9e8925ff tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:55.798432 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.quota [None req-8802fc17-69c8-4e56-82e4-07da9e8925ff tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Getting quotas for project d48b56501b0a49829c4522b171dd1159. Resources: {'cores', 'instances', 'ram'} {{(pid=117031) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 14:30:55.802320 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.quota [None req-8802fc17-69c8-4e56-82e4-07da9e8925ff tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Getting quotas for user bdbb57cd56c5450aacce437150585ea0 and project d48b56501b0a49829c4522b171dd1159. Resources: {'cores', 'instances', 'ram'} {{(pid=117031) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 14:30:55.813575 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-8802fc17-69c8-4e56-82e4-07da9e8925ff tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Going to run 1 instances... {{(pid=117031) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 16 14:30:55.815892 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-8802fc17-69c8-4e56-82e4-07da9e8925ff tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2493d2dc-e081-43d3-8292-91b4762a21e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 16 14:30:55.925048 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-8802fc17-69c8-4e56-82e4-07da9e8925ff tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.680589 Feb 16 14:30:55.925916 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 424/796] 10.222.0.110 () {60 vars in 1151 bytes} [Wed Feb 16 14:30:55 2022] POST /compute/v2.1/servers => generated 404 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Feb 16 14:30:55.936766 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-32c1633c-9bd5-4a78-b332-37fa2ef4db09 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:55.937927 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-32c1633c-9bd5-4a78-b332-37fa2ef4db09 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:56.005302 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-32c1633c-9bd5-4a78-b332-37fa2ef4db09 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:56.016375 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-32c1633c-9bd5-4a78-b332-37fa2ef4db09 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce" status: 200 len: 1241 microversion: 2.1 time: 0.083832 Feb 16 14:30:56.017132 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 373/797] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:55 2022] GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:57.034463 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-f4b1ed4d-a196-4161-a82c-07fa8c058480 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:57.035039 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-f4b1ed4d-a196-4161-a82c-07fa8c058480 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:57.042348 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f4b1ed4d-a196-4161-a82c-07fa8c058480 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:57.042837 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f4b1ed4d-a196-4161-a82c-07fa8c058480 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:57.043619 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f4b1ed4d-a196-4161-a82c-07fa8c058480 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:57.044056 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f4b1ed4d-a196-4161-a82c-07fa8c058480 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:57.111142 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-f4b1ed4d-a196-4161-a82c-07fa8c058480 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:57.118356 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-f4b1ed4d-a196-4161-a82c-07fa8c058480 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce" status: 200 len: 1245 microversion: 2.1 time: 0.087807 Feb 16 14:30:57.118957 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 425/798] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:57 2022] GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:30:58.138003 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-37619b8f-e875-4c41-84df-b848f242bc53 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:58.138776 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-37619b8f-e875-4c41-84df-b848f242bc53 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:58.148589 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-37619b8f-e875-4c41-84df-b848f242bc53 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:58.149038 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-37619b8f-e875-4c41-84df-b848f242bc53 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:58.149829 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-37619b8f-e875-4c41-84df-b848f242bc53 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:58.151086 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-37619b8f-e875-4c41-84df-b848f242bc53 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:58.230426 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-37619b8f-e875-4c41-84df-b848f242bc53 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:58.238263 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-37619b8f-e875-4c41-84df-b848f242bc53 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce" status: 200 len: 1301 microversion: 2.1 time: 0.106857 Feb 16 14:30:58.239526 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 374/799] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:58 2022] GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce => generated 1301 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:30:59.255108 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-8a44e5cd-1488-45bb-8d33-17bc9aa897fd tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:30:59.255828 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-8a44e5cd-1488-45bb-8d33-17bc9aa897fd tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:30:59.262664 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8a44e5cd-1488-45bb-8d33-17bc9aa897fd tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:59.263111 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8a44e5cd-1488-45bb-8d33-17bc9aa897fd tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:59.263903 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8a44e5cd-1488-45bb-8d33-17bc9aa897fd tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:59.264414 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8a44e5cd-1488-45bb-8d33-17bc9aa897fd tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:59.410637 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-8a44e5cd-1488-45bb-8d33-17bc9aa897fd tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:30:59.418388 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-8a44e5cd-1488-45bb-8d33-17bc9aa897fd tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce" status: 200 len: 1367 microversion: 2.1 time: 0.166879 Feb 16 14:30:59.418998 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 426/800] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:30:59 2022] GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:30:59.808916 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-bc2bcf7b-244b-4d49-9cec-c27069382224 req-155bc332-e98f-4334-b80a-ea0ff9cace91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e1bd9c3-d567-4517-8761-d154223724ce", "tag": "c29a0894-7a63-42f0-85d5-e534663d09c0"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:30:59.811956 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:30:59.811956 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: warnings.warn(msg) Feb 16 14:30:59.824996 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-bc2bcf7b-244b-4d49-9cec-c27069382224 req-155bc332-e98f-4334-b80a-ea0ff9cace91 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:30:59.826053 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-bc2bcf7b-244b-4d49-9cec-c27069382224 req-155bc332-e98f-4334-b80a-ea0ff9cace91 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:30:59.838971 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-bc2bcf7b-244b-4d49-9cec-c27069382224 req-155bc332-e98f-4334-b80a-ea0ff9cace91 service nova] Creating event network-changed:c29a0894-7a63-42f0-85d5-e534663d09c0 for instance 9e1bd9c3-d567-4517-8761-d154223724ce on hv-cinder-80473 Feb 16 14:30:59.843806 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-bc2bcf7b-244b-4d49-9cec-c27069382224 req-155bc332-e98f-4334-b80a-ea0ff9cace91 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038653 Feb 16 14:30:59.844410 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 375/801] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:31:00.435917 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-20d35393-570a-4831-84d1-244e720f3482 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:00.436531 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-20d35393-570a-4831-84d1-244e720f3482 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:00.442994 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-20d35393-570a-4831-84d1-244e720f3482 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:00.443452 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-20d35393-570a-4831-84d1-244e720f3482 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:00.444242 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-20d35393-570a-4831-84d1-244e720f3482 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:00.444688 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-20d35393-570a-4831-84d1-244e720f3482 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:00.584296 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-20d35393-570a-4831-84d1-244e720f3482 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:00.592342 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-20d35393-570a-4831-84d1-244e720f3482 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce" status: 200 len: 1367 microversion: 2.1 time: 0.160363 Feb 16 14:31:00.593595 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 427/802] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:00 2022] GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:31:01.610319 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-aa6a8d89-cdb5-404d-b46c-d443cf86f061 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:01.611244 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-aa6a8d89-cdb5-404d-b46c-d443cf86f061 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:01.617244 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-aa6a8d89-cdb5-404d-b46c-d443cf86f061 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:01.617699 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-aa6a8d89-cdb5-404d-b46c-d443cf86f061 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:01.618486 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-aa6a8d89-cdb5-404d-b46c-d443cf86f061 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:01.619202 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-aa6a8d89-cdb5-404d-b46c-d443cf86f061 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:01.753892 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-aa6a8d89-cdb5-404d-b46c-d443cf86f061 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:01.761675 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-aa6a8d89-cdb5-404d-b46c-d443cf86f061 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce" status: 200 len: 1367 microversion: 2.1 time: 0.155779 Feb 16 14:31:01.762249 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 376/803] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:01 2022] GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:02.777392 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-dfc4233c-beb7-4d0f-bae1-7e3c61e920e2 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:02.778087 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-dfc4233c-beb7-4d0f-bae1-7e3c61e920e2 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:02.784471 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-dfc4233c-beb7-4d0f-bae1-7e3c61e920e2 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:02.784922 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-dfc4233c-beb7-4d0f-bae1-7e3c61e920e2 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:02.785706 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-dfc4233c-beb7-4d0f-bae1-7e3c61e920e2 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:02.786143 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-dfc4233c-beb7-4d0f-bae1-7e3c61e920e2 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:02.933774 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-dfc4233c-beb7-4d0f-bae1-7e3c61e920e2 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:02.941425 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-dfc4233c-beb7-4d0f-bae1-7e3c61e920e2 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce" status: 200 len: 1367 microversion: 2.1 time: 0.167776 Feb 16 14:31:02.941986 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 428/804] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:02 2022] GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:03.371972 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-462780fc-447f-4065-8e87-cd4515618f11 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c511043-4a4a-469b-a399-34212713cd72"}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:31:03.373262 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-462780fc-447f-4065-8e87-cd4515618f11 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f07b0b32-9726-4fef-b3d7-31da2f0ca96f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:03.379429 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-462780fc-447f-4065-8e87-cd4515618f11 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:03.379934 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-462780fc-447f-4065-8e87-cd4515618f11 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:03.380715 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-462780fc-447f-4065-8e87-cd4515618f11 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:03.381151 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-462780fc-447f-4065-8e87-cd4515618f11 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:03.458685 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-462780fc-447f-4065-8e87-cd4515618f11 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] HTTP exception thrown: Invalid volume: volume 0c511043-4a4a-469b-a399-34212713cd72 is already attached to instances: f07b0b32-9726-4fef-b3d7-31da2f0ca96f Feb 16 14:31:03.459288 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-462780fc-447f-4065-8e87-cd4515618f11 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Returning 400 to user: Invalid volume: volume 0c511043-4a4a-469b-a399-34212713cd72 is already attached to instances: f07b0b32-9726-4fef-b3d7-31da2f0ca96f {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:31:03.460118 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-462780fc-447f-4065-8e87-cd4515618f11 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "POST /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.092267 Feb 16 14:31:03.460669 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 377/805] 10.222.0.110 () {60 vars in 1327 bytes} [Wed Feb 16 14:31:03 2022] POST /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f/os-volume_attachments => generated 174 bytes in 93 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 16 14:31:03.519375 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-1593084a-4357-4f71-b580-23037972391a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:03.519873 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-1593084a-4357-4f71-b580-23037972391a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f07b0b32-9726-4fef-b3d7-31da2f0ca96f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:03.526090 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1593084a-4357-4f71-b580-23037972391a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:03.526546 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1593084a-4357-4f71-b580-23037972391a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:03.527405 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1593084a-4357-4f71-b580-23037972391a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:03.527839 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1593084a-4357-4f71-b580-23037972391a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:03.609095 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.objects.instance [None req-1593084a-4357-4f71-b580-23037972391a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lazy-loading 'services' on Instance uuid f07b0b32-9726-4fef-b3d7-31da2f0ca96f {{(pid=117031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:31:03.818051 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-1593084a-4357-4f71-b580-23037972391a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "DELETE /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f/os-volume_attachments/0c511043-4a4a-469b-a399-34212713cd72" status: 202 len: 0 microversion: 2.1 time: 0.302222 Feb 16 14:31:03.818684 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 429/806] 10.222.0.110 () {58 vars in 1420 bytes} [Wed Feb 16 14:31:03 2022] DELETE /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f/os-volume_attachments/0c511043-4a4a-469b-a399-34212713cd72 => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 14:31:03.827747 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-243f2209-4222-4d1b-b3dd-b368a6133368 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:03.828669 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-243f2209-4222-4d1b-b3dd-b368a6133368 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f07b0b32-9726-4fef-b3d7-31da2f0ca96f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:03.838861 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-243f2209-4222-4d1b-b3dd-b368a6133368 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:03.838861 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-243f2209-4222-4d1b-b3dd-b368a6133368 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:03.838861 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-243f2209-4222-4d1b-b3dd-b368a6133368 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:03.838861 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-243f2209-4222-4d1b-b3dd-b368a6133368 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:03.868068 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-243f2209-4222-4d1b-b3dd-b368a6133368 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044184 Feb 16 14:31:03.869432 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 378/807] 10.222.0.110 () {58 vars in 1306 bytes} [Wed Feb 16 14:31:03 2022] GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:31:03.958177 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-3d280159-9914-4da5-ae69-56b386801219 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:03.958915 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-3d280159-9914-4da5-ae69-56b386801219 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:03.965679 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3d280159-9914-4da5-ae69-56b386801219 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:03.966136 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3d280159-9914-4da5-ae69-56b386801219 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:03.966964 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3d280159-9914-4da5-ae69-56b386801219 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:03.967407 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3d280159-9914-4da5-ae69-56b386801219 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:04.170783 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-3d280159-9914-4da5-ae69-56b386801219 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:04.178229 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-3d280159-9914-4da5-ae69-56b386801219 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce" status: 200 len: 1367 microversion: 2.1 time: 0.224263 Feb 16 14:31:04.178828 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 430/808] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:03 2022] GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:04.880243 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f43e018f-7705-4856-a5fe-1d7026822081 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:04.881157 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f43e018f-7705-4856-a5fe-1d7026822081 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f07b0b32-9726-4fef-b3d7-31da2f0ca96f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:04.887860 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f43e018f-7705-4856-a5fe-1d7026822081 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:04.888316 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f43e018f-7705-4856-a5fe-1d7026822081 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:04.889102 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f43e018f-7705-4856-a5fe-1d7026822081 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:04.889530 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f43e018f-7705-4856-a5fe-1d7026822081 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:04.919243 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f43e018f-7705-4856-a5fe-1d7026822081 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042727 Feb 16 14:31:04.919819 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 379/809] 10.222.0.110 () {58 vars in 1306 bytes} [Wed Feb 16 14:31:04 2022] GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:31:05.195072 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-82e2c795-620e-469a-a5bf-5643394a3928 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:05.196252 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-82e2c795-620e-469a-a5bf-5643394a3928 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:05.204302 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-82e2c795-620e-469a-a5bf-5643394a3928 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:05.208768 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-82e2c795-620e-469a-a5bf-5643394a3928 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:05.208768 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-82e2c795-620e-469a-a5bf-5643394a3928 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:05.208768 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-82e2c795-620e-469a-a5bf-5643394a3928 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:05.362792 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-82e2c795-620e-469a-a5bf-5643394a3928 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:05.373750 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-82e2c795-620e-469a-a5bf-5643394a3928 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce" status: 200 len: 1367 microversion: 2.1 time: 0.182638 Feb 16 14:31:05.380174 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 431/810] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:05 2022] GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:05.930682 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a5417b76-edaf-4b5e-ab01-d3634b93ec11 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:05.931855 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a5417b76-edaf-4b5e-ab01-d3634b93ec11 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f07b0b32-9726-4fef-b3d7-31da2f0ca96f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:05.939091 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a5417b76-edaf-4b5e-ab01-d3634b93ec11 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:05.939647 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a5417b76-edaf-4b5e-ab01-d3634b93ec11 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:05.940515 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a5417b76-edaf-4b5e-ab01-d3634b93ec11 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:05.941028 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a5417b76-edaf-4b5e-ab01-d3634b93ec11 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:05.973248 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a5417b76-edaf-4b5e-ab01-d3634b93ec11 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046279 Feb 16 14:31:05.973802 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 380/811] 10.222.0.110 () {58 vars in 1306 bytes} [Wed Feb 16 14:31:05 2022] GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 16 14:31:06.152105 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-fd30bb39-ae96-411d-966e-f46aa6c0ecd8 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2101331213", "imageRef": "2493d2dc-e081-43d3-8292-91b4762a21e8", "flavorRef": "452", "networks": [{"uuid": "36f39343-766a-4d7f-8597-906aa4ce6697"}]}} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:31:06.214735 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.network.neutron [None req-fd30bb39-ae96-411d-966e-f46aa6c0ecd8 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] validate_networks() for [('36f39343-766a-4d7f-8597-906aa4ce6697', None, None, None, None, None)] {{(pid=117031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 16 14:31:06.391863 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b94d40f9-5a5e-4ea2-baa0-a9192a52fcdd tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:06.392483 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b94d40f9-5a5e-4ea2-baa0-a9192a52fcdd tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:06.402214 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b94d40f9-5a5e-4ea2-baa0-a9192a52fcdd tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:06.402939 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b94d40f9-5a5e-4ea2-baa0-a9192a52fcdd tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:06.404084 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b94d40f9-5a5e-4ea2-baa0-a9192a52fcdd tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:06.404681 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b94d40f9-5a5e-4ea2-baa0-a9192a52fcdd tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:06.698684 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-fd30bb39-ae96-411d-966e-f46aa6c0ecd8 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Flavor limits 0:0:0 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 16 14:31:06.699371 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-fd30bb39-ae96-411d-966e-f46aa6c0ecd8 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Image limits 0:0:0 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 16 14:31:06.700188 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-fd30bb39-ae96-411d-966e-f46aa6c0ecd8 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Flavor pref 0:0:0 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 16 14:31:06.700745 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-fd30bb39-ae96-411d-966e-f46aa6c0ecd8 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Image pref 0:0:0 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 16 14:31:06.701328 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-fd30bb39-ae96-411d-966e-f46aa6c0ecd8 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 16 14:31:06.711061 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-fd30bb39-ae96-411d-966e-f46aa6c0ecd8 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:06.711506 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-fd30bb39-ae96-411d-966e-f46aa6c0ecd8 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:06.712480 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-fd30bb39-ae96-411d-966e-f46aa6c0ecd8 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:06.712918 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-fd30bb39-ae96-411d-966e-f46aa6c0ecd8 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:06.730101 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.quota [None req-fd30bb39-ae96-411d-966e-f46aa6c0ecd8 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Getting quotas for project f334385dc44348ac9942c6606482330e. Resources: {'cores', 'instances', 'ram'} {{(pid=117031) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 14:31:06.734160 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.quota [None req-fd30bb39-ae96-411d-966e-f46aa6c0ecd8 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Getting quotas for user cd0569c12f1740b9a4fab4e6a15f25ed and project f334385dc44348ac9942c6606482330e. Resources: {'cores', 'instances', 'ram'} {{(pid=117031) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 14:31:06.746247 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-fd30bb39-ae96-411d-966e-f46aa6c0ecd8 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Going to run 1 instances... {{(pid=117031) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 16 14:31:06.748789 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-fd30bb39-ae96-411d-966e-f46aa6c0ecd8 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: b4500f33-6b10-4893-96c9-fb4417e44483] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2493d2dc-e081-43d3-8292-91b4762a21e8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 16 14:31:06.909389 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-fd30bb39-ae96-411d-966e-f46aa6c0ecd8 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.762254 Feb 16 14:31:06.910287 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 432/812] 10.222.0.110 () {60 vars in 1151 bytes} [Wed Feb 16 14:31:06 2022] POST /compute/v2.1/servers => generated 382 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Feb 16 14:31:06.930436 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-c2be044b-07fe-49de-a48d-cba8f27c5004 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:06.933922 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-c2be044b-07fe-49de-a48d-cba8f27c5004 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: b4500f33-6b10-4893-96c9-fb4417e44483] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:06.936566 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b94d40f9-5a5e-4ea2-baa0-a9192a52fcdd tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:06.948537 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b94d40f9-5a5e-4ea2-baa0-a9192a52fcdd tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce" status: 200 len: 1367 microversion: 2.1 time: 0.558924 Feb 16 14:31:06.950278 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 381/813] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:06 2022] GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce => generated 1367 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:31:07.003380 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-c2be044b-07fe-49de-a48d-cba8f27c5004 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:07.013198 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-c2be044b-07fe-49de-a48d-cba8f27c5004 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483" status: 200 len: 1222 microversion: 2.1 time: 0.086606 Feb 16 14:31:07.013732 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 433/814] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:06 2022] GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483 => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:07.966109 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-34a0b8b1-b8ad-4cac-953c-40579b5b6eb7 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:07.966760 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-34a0b8b1-b8ad-4cac-953c-40579b5b6eb7 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:07.973042 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-34a0b8b1-b8ad-4cac-953c-40579b5b6eb7 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:07.973499 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-34a0b8b1-b8ad-4cac-953c-40579b5b6eb7 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:07.974286 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-34a0b8b1-b8ad-4cac-953c-40579b5b6eb7 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:07.974753 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-34a0b8b1-b8ad-4cac-953c-40579b5b6eb7 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:08.029792 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-a0ab5dfc-4c7e-40e7-8f8d-0541a2602388 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:08.030541 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-a0ab5dfc-4c7e-40e7-8f8d-0541a2602388 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: b4500f33-6b10-4893-96c9-fb4417e44483] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:08.041299 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a0ab5dfc-4c7e-40e7-8f8d-0541a2602388 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:08.042399 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a0ab5dfc-4c7e-40e7-8f8d-0541a2602388 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:08.048502 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a0ab5dfc-4c7e-40e7-8f8d-0541a2602388 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:08.050385 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a0ab5dfc-4c7e-40e7-8f8d-0541a2602388 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:08.212597 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-34a0b8b1-b8ad-4cac-953c-40579b5b6eb7 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:08.218351 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-a0ab5dfc-4c7e-40e7-8f8d-0541a2602388 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:08.225616 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-34a0b8b1-b8ad-4cac-953c-40579b5b6eb7 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce" status: 200 len: 1367 microversion: 2.1 time: 0.263365 Feb 16 14:31:08.226253 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-a0ab5dfc-4c7e-40e7-8f8d-0541a2602388 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483" status: 200 len: 1226 microversion: 2.1 time: 0.200443 Feb 16 14:31:08.227275 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 382/816] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:07 2022] GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce => generated 1367 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:08.235225 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 434/816] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:08 2022] GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483 => generated 1226 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:31:09.243210 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-0148590b-d236-48d5-9df0-1aa0067cc24a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:09.245015 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-d91cbb7c-6178-44c9-845d-50904e557a31 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:09.245629 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-d91cbb7c-6178-44c9-845d-50904e557a31 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:09.245786 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-0148590b-d236-48d5-9df0-1aa0067cc24a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: b4500f33-6b10-4893-96c9-fb4417e44483] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:09.258585 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d91cbb7c-6178-44c9-845d-50904e557a31 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:09.262481 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d91cbb7c-6178-44c9-845d-50904e557a31 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:09.263610 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d91cbb7c-6178-44c9-845d-50904e557a31 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:09.265548 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d91cbb7c-6178-44c9-845d-50904e557a31 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:09.265702 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0148590b-d236-48d5-9df0-1aa0067cc24a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:09.265702 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0148590b-d236-48d5-9df0-1aa0067cc24a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:09.265951 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0148590b-d236-48d5-9df0-1aa0067cc24a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:09.277762 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0148590b-d236-48d5-9df0-1aa0067cc24a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:09.403123 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-0148590b-d236-48d5-9df0-1aa0067cc24a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:09.415235 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-0148590b-d236-48d5-9df0-1aa0067cc24a tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483" status: 200 len: 1282 microversion: 2.1 time: 0.175611 Feb 16 14:31:09.425627 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 383/817] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:09 2022] GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483 => generated 1282 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:09.590498 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-d91cbb7c-6178-44c9-845d-50904e557a31 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:09.601055 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-d91cbb7c-6178-44c9-845d-50904e557a31 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce" status: 200 len: 1367 microversion: 2.1 time: 0.361148 Feb 16 14:31:09.602768 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 435/818] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:09 2022] GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce => generated 1367 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:09.660112 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-cac1afeb-f148-4a2f-9e43-ea516c1ed835 req-3d9b6d1d-dde1-4975-987b-10bc2f4f3828 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e1bd9c3-d567-4517-8761-d154223724ce", "name": "network-vif-plugged", "status": "completed", "tag": "c29a0894-7a63-42f0-85d5-e534663d09c0"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:31:09.661692 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:31:09.661692 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: warnings.warn(msg) Feb 16 14:31:09.675225 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-cac1afeb-f148-4a2f-9e43-ea516c1ed835 req-3d9b6d1d-dde1-4975-987b-10bc2f4f3828 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:09.682117 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-cac1afeb-f148-4a2f-9e43-ea516c1ed835 req-3d9b6d1d-dde1-4975-987b-10bc2f4f3828 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:09.695540 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-cac1afeb-f148-4a2f-9e43-ea516c1ed835 req-3d9b6d1d-dde1-4975-987b-10bc2f4f3828 service nova] Creating event network-vif-plugged:c29a0894-7a63-42f0-85d5-e534663d09c0 for instance 9e1bd9c3-d567-4517-8761-d154223724ce on hv-cinder-80473 Feb 16 14:31:09.704233 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-cac1afeb-f148-4a2f-9e43-ea516c1ed835 req-3d9b6d1d-dde1-4975-987b-10bc2f4f3828 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.282656 Feb 16 14:31:09.705140 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 384/819] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:31:10.434930 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-e19b7a46-c393-4706-a94d-4d1d42c1f996 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:10.437636 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-e19b7a46-c393-4706-a94d-4d1d42c1f996 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: b4500f33-6b10-4893-96c9-fb4417e44483] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:10.446157 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e19b7a46-c393-4706-a94d-4d1d42c1f996 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:10.447475 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e19b7a46-c393-4706-a94d-4d1d42c1f996 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:10.449279 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e19b7a46-c393-4706-a94d-4d1d42c1f996 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:10.449957 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e19b7a46-c393-4706-a94d-4d1d42c1f996 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:10.619040 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-e19b7a46-c393-4706-a94d-4d1d42c1f996 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:10.619326 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-2d5e75fd-9d0c-4473-8a03-66cd966e9e7a tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:10.620235 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-2d5e75fd-9d0c-4473-8a03-66cd966e9e7a tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:10.628978 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-e19b7a46-c393-4706-a94d-4d1d42c1f996 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483" status: 200 len: 1322 microversion: 2.1 time: 0.199174 Feb 16 14:31:10.629928 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 436/820] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:10 2022] GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:10.639259 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2d5e75fd-9d0c-4473-8a03-66cd966e9e7a tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:10.642996 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2d5e75fd-9d0c-4473-8a03-66cd966e9e7a tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:10.644568 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2d5e75fd-9d0c-4473-8a03-66cd966e9e7a tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:10.645653 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2d5e75fd-9d0c-4473-8a03-66cd966e9e7a tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:10.898041 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-2d5e75fd-9d0c-4473-8a03-66cd966e9e7a tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:10.906080 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-2d5e75fd-9d0c-4473-8a03-66cd966e9e7a tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce" status: 200 len: 1367 microversion: 2.1 time: 0.292334 Feb 16 14:31:10.914105 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 385/821] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:10 2022] GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce => generated 1367 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:31:11.585263 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-b5d44da9-093d-4c8f-ace3-22c4f630aba6 req-f3050df2-982d-4ce1-934a-d7d5d7898257 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4500f33-6b10-4893-96c9-fb4417e44483", "tag": "de6937e7-2d6b-499a-b10e-87f05040921a"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:31:11.586854 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:31:11.586854 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:31:11.596901 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-b5d44da9-093d-4c8f-ace3-22c4f630aba6 req-f3050df2-982d-4ce1-934a-d7d5d7898257 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:11.598379 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-b5d44da9-093d-4c8f-ace3-22c4f630aba6 req-f3050df2-982d-4ce1-934a-d7d5d7898257 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:11.616985 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-b5d44da9-093d-4c8f-ace3-22c4f630aba6 req-f3050df2-982d-4ce1-934a-d7d5d7898257 service nova] Creating event network-changed:de6937e7-2d6b-499a-b10e-87f05040921a for instance b4500f33-6b10-4893-96c9-fb4417e44483 on hv-cinder-80473 Feb 16 14:31:11.617236 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-b5d44da9-093d-4c8f-ace3-22c4f630aba6 req-f3050df2-982d-4ce1-934a-d7d5d7898257 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035800 Feb 16 14:31:11.617838 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 437/822] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 14:31:11.648564 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f4cb55da-589d-4e10-80cf-e3d87ee72938 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:11.650746 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f4cb55da-589d-4e10-80cf-e3d87ee72938 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: b4500f33-6b10-4893-96c9-fb4417e44483] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:11.658096 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f4cb55da-589d-4e10-80cf-e3d87ee72938 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:11.658587 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f4cb55da-589d-4e10-80cf-e3d87ee72938 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:11.659548 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f4cb55da-589d-4e10-80cf-e3d87ee72938 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:11.660089 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f4cb55da-589d-4e10-80cf-e3d87ee72938 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:11.923833 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-88c17fe1-57c0-4408-b6fa-2d799877e015 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:11.925245 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-88c17fe1-57c0-4408-b6fa-2d799877e015 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:11.945386 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-88c17fe1-57c0-4408-b6fa-2d799877e015 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:11.945851 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-88c17fe1-57c0-4408-b6fa-2d799877e015 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:11.951042 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-88c17fe1-57c0-4408-b6fa-2d799877e015 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:11.951506 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-88c17fe1-57c0-4408-b6fa-2d799877e015 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:11.966644 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f4cb55da-589d-4e10-80cf-e3d87ee72938 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:11.984806 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f4cb55da-589d-4e10-80cf-e3d87ee72938 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483" status: 200 len: 1322 microversion: 2.1 time: 0.340006 Feb 16 14:31:11.999373 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 386/823] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:11 2022] GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483 => generated 1322 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:12.327659 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-88c17fe1-57c0-4408-b6fa-2d799877e015 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:12.336234 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-88c17fe1-57c0-4408-b6fa-2d799877e015 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce" status: 200 len: 1367 microversion: 2.1 time: 0.416940 Feb 16 14:31:12.337984 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 438/824] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:11 2022] GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce => generated 1367 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:31:13.003138 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-43abebd3-920f-4c1b-bf76-9e4445e7c4b8 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:13.003766 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-43abebd3-920f-4c1b-bf76-9e4445e7c4b8 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: b4500f33-6b10-4893-96c9-fb4417e44483] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:13.010993 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-43abebd3-920f-4c1b-bf76-9e4445e7c4b8 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:13.011472 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-43abebd3-920f-4c1b-bf76-9e4445e7c4b8 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:13.012268 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-43abebd3-920f-4c1b-bf76-9e4445e7c4b8 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:13.012711 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-43abebd3-920f-4c1b-bf76-9e4445e7c4b8 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:13.179219 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-43abebd3-920f-4c1b-bf76-9e4445e7c4b8 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:13.194922 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-43abebd3-920f-4c1b-bf76-9e4445e7c4b8 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483" status: 200 len: 1322 microversion: 2.1 time: 0.196249 Feb 16 14:31:13.206060 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 387/825] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:12 2022] GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:13.353289 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-cad50e86-1d4a-4ea2-9710-0f031303287f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:13.354210 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-cad50e86-1d4a-4ea2-9710-0f031303287f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:13.361520 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-cad50e86-1d4a-4ea2-9710-0f031303287f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:13.361975 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-cad50e86-1d4a-4ea2-9710-0f031303287f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:13.362848 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-cad50e86-1d4a-4ea2-9710-0f031303287f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:13.363290 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-cad50e86-1d4a-4ea2-9710-0f031303287f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:13.593244 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-cad50e86-1d4a-4ea2-9710-0f031303287f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:13.600532 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-cad50e86-1d4a-4ea2-9710-0f031303287f tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce" status: 200 len: 1554 microversion: 2.1 time: 0.251025 Feb 16 14:31:13.601101 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 439/826] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:13 2022] GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce => generated 1554 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:13.617792 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-78b79462-d1fd-4175-91e1-07ab0ce47e85 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:13.618282 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-78b79462-d1fd-4175-91e1-07ab0ce47e85 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:13.624114 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-78b79462-d1fd-4175-91e1-07ab0ce47e85 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:13.624567 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-78b79462-d1fd-4175-91e1-07ab0ce47e85 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:13.625348 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-78b79462-d1fd-4175-91e1-07ab0ce47e85 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:13.625790 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-78b79462-d1fd-4175-91e1-07ab0ce47e85 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:13.888281 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-78b79462-d1fd-4175-91e1-07ab0ce47e85 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.274134 Feb 16 14:31:13.889519 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 388/827] 10.222.0.110 () {58 vars in 1279 bytes} [Wed Feb 16 14:31:13 2022] GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce/os-interface => generated 285 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:31:14.213384 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-5de22c23-8fc9-4337-a671-5659248505ec tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:14.217501 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-5de22c23-8fc9-4337-a671-5659248505ec tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: b4500f33-6b10-4893-96c9-fb4417e44483] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:14.226495 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5de22c23-8fc9-4337-a671-5659248505ec tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:14.227185 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5de22c23-8fc9-4337-a671-5659248505ec tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:14.229148 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5de22c23-8fc9-4337-a671-5659248505ec tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:14.229949 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5de22c23-8fc9-4337-a671-5659248505ec tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:14.389244 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-5de22c23-8fc9-4337-a671-5659248505ec tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:14.398218 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-5de22c23-8fc9-4337-a671-5659248505ec tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483" status: 200 len: 1322 microversion: 2.1 time: 0.189035 Feb 16 14:31:14.412393 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 440/828] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:14 2022] GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483 => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:15.105552 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-cb2afe05-3864-4211-85a4-b35dd20a2b75 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:15.106651 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-cb2afe05-3864-4211-85a4-b35dd20a2b75 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:15.108630 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-5407a915-72fc-4101-bb4a-05e12eb22fdc req-10ef0208-bda2-491c-b420-8ddf05648514 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e1bd9c3-d567-4517-8761-d154223724ce", "tag": "c29a0894-7a63-42f0-85d5-e534663d09c0"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:31:15.111883 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:31:15.111883 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:31:15.118427 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cb2afe05-3864-4211-85a4-b35dd20a2b75 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:15.119265 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cb2afe05-3864-4211-85a4-b35dd20a2b75 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:15.119898 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-5407a915-72fc-4101-bb4a-05e12eb22fdc req-10ef0208-bda2-491c-b420-8ddf05648514 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:15.120080 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cb2afe05-3864-4211-85a4-b35dd20a2b75 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:15.120636 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-5407a915-72fc-4101-bb4a-05e12eb22fdc req-10ef0208-bda2-491c-b420-8ddf05648514 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:15.123864 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cb2afe05-3864-4211-85a4-b35dd20a2b75 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:15.137560 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-5407a915-72fc-4101-bb4a-05e12eb22fdc req-10ef0208-bda2-491c-b420-8ddf05648514 service nova] Creating event network-changed:c29a0894-7a63-42f0-85d5-e534663d09c0 for instance 9e1bd9c3-d567-4517-8761-d154223724ce on hv-cinder-80473 Feb 16 14:31:15.155437 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-5407a915-72fc-4101-bb4a-05e12eb22fdc req-10ef0208-bda2-491c-b420-8ddf05648514 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052433 Feb 16 14:31:15.156670 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 441/829] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:31:15.171861 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-cb2afe05-3864-4211-85a4-b35dd20a2b75 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce/ips" status: 200 len: 107 microversion: 2.1 time: 0.070976 Feb 16 14:31:15.174228 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 389/830] 10.222.0.110 () {58 vars in 1252 bytes} [Wed Feb 16 14:31:15 2022] GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce/ips => generated 107 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:31:15.419880 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-26c453b5-b481-4f79-9873-b37e3a353ff5 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:15.420574 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-26c453b5-b481-4f79-9873-b37e3a353ff5 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: b4500f33-6b10-4893-96c9-fb4417e44483] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:15.453402 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-26c453b5-b481-4f79-9873-b37e3a353ff5 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:15.458800 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-26c453b5-b481-4f79-9873-b37e3a353ff5 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:15.459899 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-26c453b5-b481-4f79-9873-b37e3a353ff5 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:15.461616 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-26c453b5-b481-4f79-9873-b37e3a353ff5 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:15.677888 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-26c453b5-b481-4f79-9873-b37e3a353ff5 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:15.686819 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-26c453b5-b481-4f79-9873-b37e3a353ff5 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483" status: 200 len: 1322 microversion: 2.1 time: 0.273105 Feb 16 14:31:15.687614 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 442/831] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:15 2022] GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483 => generated 1322 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:16.706137 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-37b36730-2eae-4e33-bb60-98ba3869d2c5 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:16.706908 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-37b36730-2eae-4e33-bb60-98ba3869d2c5 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: b4500f33-6b10-4893-96c9-fb4417e44483] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:16.713299 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-37b36730-2eae-4e33-bb60-98ba3869d2c5 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:16.713747 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-37b36730-2eae-4e33-bb60-98ba3869d2c5 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:16.714659 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-37b36730-2eae-4e33-bb60-98ba3869d2c5 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:16.715110 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-37b36730-2eae-4e33-bb60-98ba3869d2c5 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:16.929723 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-37b36730-2eae-4e33-bb60-98ba3869d2c5 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:16.939594 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-37b36730-2eae-4e33-bb60-98ba3869d2c5 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483" status: 200 len: 1322 microversion: 2.1 time: 0.239052 Feb 16 14:31:16.941003 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 390/832] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:16 2022] GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:17.021480 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-b159cccd-3bc3-4c30-afa1-6e6230e72a02 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb690fb5-cc28-4334-bfb1-da31ca2bc2b7"}} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:31:17.023242 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-b159cccd-3bc3-4c30-afa1-6e6230e72a02 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:17.037399 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b159cccd-3bc3-4c30-afa1-6e6230e72a02 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:17.037856 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b159cccd-3bc3-4c30-afa1-6e6230e72a02 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:17.038671 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b159cccd-3bc3-4c30-afa1-6e6230e72a02 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:17.045906 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b159cccd-3bc3-4c30-afa1-6e6230e72a02 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:17.277062 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-8ebe1b25-6161-42c8-98b3-6ff99f1f458e tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Action: 'create', calling method: .version_select at 0x7f2990daf940>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-203474760"}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:31:17.291831 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-8ebe1b25-6161-42c8-98b3-6ff99f1f458e tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Getting quotas for project a072f4cf28da4e14b3fd13b1ba2a9686. Resources: {'key_pairs'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 14:31:17.296107 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-8ebe1b25-6161-42c8-98b3-6ff99f1f458e tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Getting quotas for user 44f75877ea98492e95bfe67b250891e6 and project a072f4cf28da4e14b3fd13b1ba2a9686. Resources: {'key_pairs'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 14:31:17.647330 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-8ebe1b25-6161-42c8-98b3-6ff99f1f458e tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Getting quotas for project a072f4cf28da4e14b3fd13b1ba2a9686. Resources: {'key_pairs'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 14:31:17.651895 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-8ebe1b25-6161-42c8-98b3-6ff99f1f458e tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Getting quotas for user 44f75877ea98492e95bfe67b250891e6 and project a072f4cf28da4e14b3fd13b1ba2a9686. Resources: {'key_pairs'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 14:31:17.666897 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-8ebe1b25-6161-42c8-98b3-6ff99f1f458e tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.579375 Feb 16 14:31:17.673085 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 391/833] 10.222.0.110 () {60 vars in 1162 bytes} [Wed Feb 16 14:31:17 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:17.956861 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-cf3fb5e9-bf20-4697-b9e9-8e99c2a77080 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:17.957722 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-cf3fb5e9-bf20-4697-b9e9-8e99c2a77080 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: b4500f33-6b10-4893-96c9-fb4417e44483] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:17.964561 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cf3fb5e9-bf20-4697-b9e9-8e99c2a77080 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:17.965942 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cf3fb5e9-bf20-4697-b9e9-8e99c2a77080 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:17.965942 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cf3fb5e9-bf20-4697-b9e9-8e99c2a77080 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:17.966381 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cf3fb5e9-bf20-4697-b9e9-8e99c2a77080 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:18.006723 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-b159cccd-3bc3-4c30-afa1-6e6230e72a02 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "POST /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.988642 Feb 16 14:31:18.006723 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 443/834] 10.222.0.110 () {60 vars in 1327 bytes} [Wed Feb 16 14:31:17 2022] POST /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce/os-volume_attachments => generated 194 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:31:18.136037 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-cf3fb5e9-bf20-4697-b9e9-8e99c2a77080 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:18.146205 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-cf3fb5e9-bf20-4697-b9e9-8e99c2a77080 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483" status: 200 len: 1322 microversion: 2.1 time: 0.192506 Feb 16 14:31:18.147299 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 392/835] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:17 2022] GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483 => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:31:19.165014 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-67277faa-bd38-4b13-9953-2eb688dd893f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:19.166441 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-67277faa-bd38-4b13-9953-2eb688dd893f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: b4500f33-6b10-4893-96c9-fb4417e44483] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:19.172571 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-67277faa-bd38-4b13-9953-2eb688dd893f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:19.173011 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-67277faa-bd38-4b13-9953-2eb688dd893f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:19.173809 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-67277faa-bd38-4b13-9953-2eb688dd893f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:19.174235 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-67277faa-bd38-4b13-9953-2eb688dd893f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:19.332744 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-67277faa-bd38-4b13-9953-2eb688dd893f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:19.342319 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-67277faa-bd38-4b13-9953-2eb688dd893f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483" status: 200 len: 1322 microversion: 2.1 time: 0.181716 Feb 16 14:31:19.343298 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 444/836] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:19 2022] GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:20.359950 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-2dc1b06e-82ae-45f4-bfca-615997bdab25 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:20.360717 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-2dc1b06e-82ae-45f4-bfca-615997bdab25 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: b4500f33-6b10-4893-96c9-fb4417e44483] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:20.367015 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2dc1b06e-82ae-45f4-bfca-615997bdab25 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:20.367477 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2dc1b06e-82ae-45f4-bfca-615997bdab25 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:20.368269 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2dc1b06e-82ae-45f4-bfca-615997bdab25 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:20.369134 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2dc1b06e-82ae-45f4-bfca-615997bdab25 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:20.528813 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-2dc1b06e-82ae-45f4-bfca-615997bdab25 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:20.537026 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-2dc1b06e-82ae-45f4-bfca-615997bdab25 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483" status: 200 len: 1322 microversion: 2.1 time: 0.180748 Feb 16 14:31:20.537599 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 393/837] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:20 2022] GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:21.360459 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-85cb0def-c864-4b6d-b5bc-caf6c7c50225 req-2c1e30b9-7975-43e9-a6e6-6c8ff58a68ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4500f33-6b10-4893-96c9-fb4417e44483", "name": "network-vif-plugged", "status": "completed", "tag": "de6937e7-2d6b-499a-b10e-87f05040921a"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:31:21.362866 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:31:21.362866 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:31:21.381210 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-85cb0def-c864-4b6d-b5bc-caf6c7c50225 req-2c1e30b9-7975-43e9-a6e6-6c8ff58a68ce service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:21.381906 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-85cb0def-c864-4b6d-b5bc-caf6c7c50225 req-2c1e30b9-7975-43e9-a6e6-6c8ff58a68ce service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:21.394358 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-85cb0def-c864-4b6d-b5bc-caf6c7c50225 req-2c1e30b9-7975-43e9-a6e6-6c8ff58a68ce service nova] Creating event network-vif-plugged:de6937e7-2d6b-499a-b10e-87f05040921a for instance b4500f33-6b10-4893-96c9-fb4417e44483 on hv-cinder-80473 Feb 16 14:31:21.399634 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-85cb0def-c864-4b6d-b5bc-caf6c7c50225 req-2c1e30b9-7975-43e9-a6e6-6c8ff58a68ce service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043886 Feb 16 14:31:21.406662 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 445/838] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 14:31:21.556303 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-64ff4452-289e-463e-a9db-83ae17e02468 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:21.557053 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-64ff4452-289e-463e-a9db-83ae17e02468 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: b4500f33-6b10-4893-96c9-fb4417e44483] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:21.567545 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-64ff4452-289e-463e-a9db-83ae17e02468 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:21.568276 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-64ff4452-289e-463e-a9db-83ae17e02468 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:21.569365 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-64ff4452-289e-463e-a9db-83ae17e02468 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:21.571372 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-64ff4452-289e-463e-a9db-83ae17e02468 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:21.750703 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-64ff4452-289e-463e-a9db-83ae17e02468 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:21.763265 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-64ff4452-289e-463e-a9db-83ae17e02468 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483" status: 200 len: 1322 microversion: 2.1 time: 0.212686 Feb 16 14:31:21.763849 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 394/839] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:21 2022] GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:22.781584 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-187bff40-e61b-49e6-92f2-8a63c4fdd966 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:22.782323 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-187bff40-e61b-49e6-92f2-8a63c4fdd966 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: b4500f33-6b10-4893-96c9-fb4417e44483] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:22.793377 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-187bff40-e61b-49e6-92f2-8a63c4fdd966 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:22.794170 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-187bff40-e61b-49e6-92f2-8a63c4fdd966 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:22.795412 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-187bff40-e61b-49e6-92f2-8a63c4fdd966 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:22.796153 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-187bff40-e61b-49e6-92f2-8a63c4fdd966 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:22.946782 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-187bff40-e61b-49e6-92f2-8a63c4fdd966 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:22.957418 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-187bff40-e61b-49e6-92f2-8a63c4fdd966 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483" status: 200 len: 1322 microversion: 2.1 time: 0.180081 Feb 16 14:31:22.958112 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 446/840] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:22 2022] GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:23.974958 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-7e367c52-054f-4abd-9745-1f9743202e64 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:23.975569 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-7e367c52-054f-4abd-9745-1f9743202e64 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: b4500f33-6b10-4893-96c9-fb4417e44483] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:23.982516 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7e367c52-054f-4abd-9745-1f9743202e64 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:23.983002 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7e367c52-054f-4abd-9745-1f9743202e64 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:23.983787 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7e367c52-054f-4abd-9745-1f9743202e64 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:23.984230 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7e367c52-054f-4abd-9745-1f9743202e64 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:24.129219 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-7e367c52-054f-4abd-9745-1f9743202e64 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:24.136778 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-7e367c52-054f-4abd-9745-1f9743202e64 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483" status: 200 len: 1513 microversion: 2.1 time: 0.165569 Feb 16 14:31:24.145896 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 395/841] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:23 2022] GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:31:25.710916 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-39d52ceb-e89c-43c4-877d-cc265c6baa28 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1aa0d06-c35c-4eb2-ae86-8d1e03547800"}} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:31:25.712014 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-39d52ceb-e89c-43c4-877d-cc265c6baa28 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: b4500f33-6b10-4893-96c9-fb4417e44483] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:25.720261 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-39d52ceb-e89c-43c4-877d-cc265c6baa28 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:25.720719 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-39d52ceb-e89c-43c4-877d-cc265c6baa28 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:25.721495 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-39d52ceb-e89c-43c4-877d-cc265c6baa28 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:25.722160 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-39d52ceb-e89c-43c4-877d-cc265c6baa28 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:26.337639 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-39d52ceb-e89c-43c4-877d-cc265c6baa28 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "POST /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.629910 Feb 16 14:31:26.338240 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 447/842] 10.222.0.110 () {60 vars in 1327 bytes} [Wed Feb 16 14:31:25 2022] POST /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483/os-volume_attachments => generated 194 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:31:26.593319 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-0f5406ac-bdc5-488d-bf92-74dd65032b44 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:26.594822 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-0f5406ac-bdc5-488d-bf92-74dd65032b44 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:26.600982 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0f5406ac-bdc5-488d-bf92-74dd65032b44 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:26.601429 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0f5406ac-bdc5-488d-bf92-74dd65032b44 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:26.602209 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0f5406ac-bdc5-488d-bf92-74dd65032b44 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:26.603916 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0f5406ac-bdc5-488d-bf92-74dd65032b44 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:26.636743 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-0f5406ac-bdc5-488d-bf92-74dd65032b44 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047029 Feb 16 14:31:26.637319 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 396/843] 10.222.0.110 () {58 vars in 1306 bytes} [Wed Feb 16 14:31:26 2022] GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:31:26.647690 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-33d6dc59-c0ea-476f-8daa-a620cf2d8f5d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:26.648407 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-33d6dc59-c0ea-476f-8daa-a620cf2d8f5d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:26.655184 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-33d6dc59-c0ea-476f-8daa-a620cf2d8f5d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:26.655711 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-33d6dc59-c0ea-476f-8daa-a620cf2d8f5d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:26.656491 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-33d6dc59-c0ea-476f-8daa-a620cf2d8f5d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:26.656931 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-33d6dc59-c0ea-476f-8daa-a620cf2d8f5d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:26.686054 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-33d6dc59-c0ea-476f-8daa-a620cf2d8f5d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce/os-volume_attachments/fb690fb5-cc28-4334-bfb1-da31ca2bc2b7" status: 200 len: 194 microversion: 2.1 time: 0.042565 Feb 16 14:31:26.686639 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 448/844] 10.222.0.110 () {58 vars in 1417 bytes} [Wed Feb 16 14:31:26 2022] GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce/os-volume_attachments/fb690fb5-cc28-4334-bfb1-da31ca2bc2b7 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:31:28.340521 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-761ff950-55a8-422a-889f-617e7d92c704 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2352f66e-dcdc-4a66-9718-08ba6f20779e"}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:31:28.341587 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-761ff950-55a8-422a-889f-617e7d92c704 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:28.348215 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-761ff950-55a8-422a-889f-617e7d92c704 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:28.348666 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-761ff950-55a8-422a-889f-617e7d92c704 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:28.349571 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-761ff950-55a8-422a-889f-617e7d92c704 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:28.350015 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-761ff950-55a8-422a-889f-617e7d92c704 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:28.999362 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-761ff950-55a8-422a-889f-617e7d92c704 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "POST /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.663481 Feb 16 14:31:28.999974 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 397/845] 10.222.0.110 () {60 vars in 1327 bytes} [Wed Feb 16 14:31:28 2022] POST /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce/os-volume_attachments => generated 194 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:31:34.941055 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-bb31f804-8e7f-45f2-99cc-5d94d07e898f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:34.941558 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-bb31f804-8e7f-45f2-99cc-5d94d07e898f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: b4500f33-6b10-4893-96c9-fb4417e44483] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:34.948170 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-bb31f804-8e7f-45f2-99cc-5d94d07e898f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:34.948608 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-bb31f804-8e7f-45f2-99cc-5d94d07e898f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:34.949406 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-bb31f804-8e7f-45f2-99cc-5d94d07e898f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:34.949829 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-bb31f804-8e7f-45f2-99cc-5d94d07e898f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:35.027227 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.objects.instance [None req-bb31f804-8e7f-45f2-99cc-5d94d07e898f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lazy-loading 'services' on Instance uuid b4500f33-6b10-4893-96c9-fb4417e44483 {{(pid=117031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:31:35.205949 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-bb31f804-8e7f-45f2-99cc-5d94d07e898f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "DELETE /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483/os-volume_attachments/a1aa0d06-c35c-4eb2-ae86-8d1e03547800" status: 202 len: 0 microversion: 2.1 time: 0.268327 Feb 16 14:31:35.206526 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 449/846] 10.222.0.110 () {58 vars in 1420 bytes} [Wed Feb 16 14:31:34 2022] DELETE /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483/os-volume_attachments/a1aa0d06-c35c-4eb2-ae86-8d1e03547800 => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 14:31:35.222171 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6b253b59-3c23-4bec-bba7-42d316000fee tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:35.223282 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-6b253b59-3c23-4bec-bba7-42d316000fee tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: b4500f33-6b10-4893-96c9-fb4417e44483] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:35.229806 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6b253b59-3c23-4bec-bba7-42d316000fee tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:35.230266 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6b253b59-3c23-4bec-bba7-42d316000fee tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:35.234420 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6b253b59-3c23-4bec-bba7-42d316000fee tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:35.234420 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6b253b59-3c23-4bec-bba7-42d316000fee tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:35.257353 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-461b5bdc-a2c4-4afc-8142-f7c00a18958f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:31:35.257973 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-461b5bdc-a2c4-4afc-8142-f7c00a18958f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:35.262133 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-6b253b59-3c23-4bec-bba7-42d316000fee tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050997 Feb 16 14:31:35.262716 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 398/847] 10.222.0.110 () {58 vars in 1306 bytes} [Wed Feb 16 14:31:35 2022] GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:31:35.264903 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-461b5bdc-a2c4-4afc-8142-f7c00a18958f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:35.268907 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-461b5bdc-a2c4-4afc-8142-f7c00a18958f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:35.268907 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-461b5bdc-a2c4-4afc-8142-f7c00a18958f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:35.268907 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-461b5bdc-a2c4-4afc-8142-f7c00a18958f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:35.290836 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.objects.instance [None req-461b5bdc-a2c4-4afc-8142-f7c00a18958f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lazy-loading 'flavor' on Instance uuid 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d {{(pid=117031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:31:35.780880 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-461b5bdc-a2c4-4afc-8142-f7c00a18958f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "POST /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d/action" status: 202 len: 0 microversion: 2.20 time: 0.524675 Feb 16 14:31:35.780880 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 450/848] 10.222.0.110 () {62 vars in 1323 bytes} [Wed Feb 16 14:31:35 2022] POST /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d/action => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Feb 16 14:31:35.787149 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6086aa44-86bd-45f5-a94f-69700df4de5c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:35.787997 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-6086aa44-86bd-45f5-a94f-69700df4de5c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:35.794922 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6086aa44-86bd-45f5-a94f-69700df4de5c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:35.795372 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6086aa44-86bd-45f5-a94f-69700df4de5c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:35.796324 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6086aa44-86bd-45f5-a94f-69700df4de5c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:35.796765 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6086aa44-86bd-45f5-a94f-69700df4de5c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:35.942213 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6086aa44-86bd-45f5-a94f-69700df4de5c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:35.950586 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6086aa44-86bd-45f5-a94f-69700df4de5c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:35.952393 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6086aa44-86bd-45f5-a94f-69700df4de5c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:35.953560 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-6086aa44-86bd-45f5-a94f-69700df4de5c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1723 microversion: 2.20 time: 0.170591 Feb 16 14:31:35.954119 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 399/849] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:31:35 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:31:36.168960 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-49168c0f-0c2e-4ff6-ae99-5e5bb0a608bf tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:31:36.169987 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-49168c0f-0c2e-4ff6-ae99-5e5bb0a608bf tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:36.176866 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-49168c0f-0c2e-4ff6-ae99-5e5bb0a608bf tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:36.177686 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-49168c0f-0c2e-4ff6-ae99-5e5bb0a608bf tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:36.185103 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-49168c0f-0c2e-4ff6-ae99-5e5bb0a608bf tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:36.185103 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-49168c0f-0c2e-4ff6-ae99-5e5bb0a608bf tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:36.273593 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-57080c79-53e8-4e21-a1b7-e8e14105db18 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:36.275532 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-57080c79-53e8-4e21-a1b7-e8e14105db18 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: b4500f33-6b10-4893-96c9-fb4417e44483] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:36.281519 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-57080c79-53e8-4e21-a1b7-e8e14105db18 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:36.281968 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-57080c79-53e8-4e21-a1b7-e8e14105db18 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:36.282775 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-57080c79-53e8-4e21-a1b7-e8e14105db18 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:36.283217 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-57080c79-53e8-4e21-a1b7-e8e14105db18 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:36.312665 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-57080c79-53e8-4e21-a1b7-e8e14105db18 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042833 Feb 16 14:31:36.313243 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 400/850] 10.222.0.110 () {58 vars in 1306 bytes} [Wed Feb 16 14:31:36 2022] GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 14:31:36.405521 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-49168c0f-0c2e-4ff6-ae99-5e5bb0a608bf tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "POST /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde/action" status: 202 len: 0 microversion: 2.1 time: 0.242846 Feb 16 14:31:36.409673 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 451/851] 10.222.0.110 () {60 vars in 1282 bytes} [Wed Feb 16 14:31:36 2022] POST /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 16 14:31:36.414261 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-7b8cca25-ba75-4afb-bab2-455af249752f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:36.414952 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-7b8cca25-ba75-4afb-bab2-455af249752f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:36.421192 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7b8cca25-ba75-4afb-bab2-455af249752f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:36.421636 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7b8cca25-ba75-4afb-bab2-455af249752f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:36.422529 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7b8cca25-ba75-4afb-bab2-455af249752f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:36.422878 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7b8cca25-ba75-4afb-bab2-455af249752f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:36.589860 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-7b8cca25-ba75-4afb-bab2-455af249752f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:36.597834 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-7b8cca25-ba75-4afb-bab2-455af249752f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1754 microversion: 2.1 time: 0.187146 Feb 16 14:31:36.598405 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 401/852] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:36 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1754 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:36.973336 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-3e479184-182a-4664-a520-85f89f7f11e0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:36.974070 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-3e479184-182a-4664-a520-85f89f7f11e0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:36.980709 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3e479184-182a-4664-a520-85f89f7f11e0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:36.981274 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3e479184-182a-4664-a520-85f89f7f11e0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:36.982060 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3e479184-182a-4664-a520-85f89f7f11e0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:36.982495 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3e479184-182a-4664-a520-85f89f7f11e0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:37.115515 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-3e479184-182a-4664-a520-85f89f7f11e0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:37.124035 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-3e479184-182a-4664-a520-85f89f7f11e0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:37.125546 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-3e479184-182a-4664-a520-85f89f7f11e0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:37.126756 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-3e479184-182a-4664-a520-85f89f7f11e0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1723 microversion: 2.20 time: 0.157534 Feb 16 14:31:37.127314 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 452/853] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:31:36 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:31:37.324018 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-0f1517fa-e47a-4e66-b9b5-628f7cc87458 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:37.324969 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-0f1517fa-e47a-4e66-b9b5-628f7cc87458 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: b4500f33-6b10-4893-96c9-fb4417e44483] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:37.331511 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0f1517fa-e47a-4e66-b9b5-628f7cc87458 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:37.331967 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0f1517fa-e47a-4e66-b9b5-628f7cc87458 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:37.332751 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0f1517fa-e47a-4e66-b9b5-628f7cc87458 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:37.333196 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0f1517fa-e47a-4e66-b9b5-628f7cc87458 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:37.364054 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-0f1517fa-e47a-4e66-b9b5-628f7cc87458 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044219 Feb 16 14:31:37.364621 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 402/854] 10.222.0.110 () {58 vars in 1306 bytes} [Wed Feb 16 14:31:37 2022] GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:31:37.615545 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-96404c04-9c54-4a06-96ce-dd3993a66092 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:37.616049 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-96404c04-9c54-4a06-96ce-dd3993a66092 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:37.622266 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-96404c04-9c54-4a06-96ce-dd3993a66092 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:37.622732 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-96404c04-9c54-4a06-96ce-dd3993a66092 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:37.623502 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-96404c04-9c54-4a06-96ce-dd3993a66092 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:37.623929 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-96404c04-9c54-4a06-96ce-dd3993a66092 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:37.767101 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-96404c04-9c54-4a06-96ce-dd3993a66092 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:37.775891 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-96404c04-9c54-4a06-96ce-dd3993a66092 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1759 microversion: 2.1 time: 0.163663 Feb 16 14:31:37.776463 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 453/855] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:37 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1759 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:38.144882 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-fdbeeeac-f52f-4c29-891a-716bbde9d2d9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:38.145525 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-fdbeeeac-f52f-4c29-891a-716bbde9d2d9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:38.152004 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fdbeeeac-f52f-4c29-891a-716bbde9d2d9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:38.152460 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fdbeeeac-f52f-4c29-891a-716bbde9d2d9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:38.153243 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fdbeeeac-f52f-4c29-891a-716bbde9d2d9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:38.153685 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fdbeeeac-f52f-4c29-891a-716bbde9d2d9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:38.302577 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-fdbeeeac-f52f-4c29-891a-716bbde9d2d9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:38.310857 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-fdbeeeac-f52f-4c29-891a-716bbde9d2d9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:38.312415 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-fdbeeeac-f52f-4c29-891a-716bbde9d2d9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:38.313587 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-fdbeeeac-f52f-4c29-891a-716bbde9d2d9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1723 microversion: 2.20 time: 0.172448 Feb 16 14:31:38.314164 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 403/856] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:31:38 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:31:38.375987 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-ddda2852-083c-418b-9e65-4d8f9306f4fd tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:38.376971 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-ddda2852-083c-418b-9e65-4d8f9306f4fd tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: b4500f33-6b10-4893-96c9-fb4417e44483] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:38.382854 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ddda2852-083c-418b-9e65-4d8f9306f4fd tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:38.383298 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ddda2852-083c-418b-9e65-4d8f9306f4fd tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:38.384367 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ddda2852-083c-418b-9e65-4d8f9306f4fd tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:38.384805 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ddda2852-083c-418b-9e65-4d8f9306f4fd tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:38.413069 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-ddda2852-083c-418b-9e65-4d8f9306f4fd tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040795 Feb 16 14:31:38.413615 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 454/857] 10.222.0.110 () {58 vars in 1306 bytes} [Wed Feb 16 14:31:38 2022] GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:31:38.794195 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-7aca7321-e16a-4845-a676-4801c435bc55 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:38.794862 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-7aca7321-e16a-4845-a676-4801c435bc55 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:38.801154 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7aca7321-e16a-4845-a676-4801c435bc55 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:38.801690 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7aca7321-e16a-4845-a676-4801c435bc55 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:38.802467 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7aca7321-e16a-4845-a676-4801c435bc55 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:38.802928 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7aca7321-e16a-4845-a676-4801c435bc55 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:38.965545 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-7aca7321-e16a-4845-a676-4801c435bc55 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:38.974366 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-7aca7321-e16a-4845-a676-4801c435bc55 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1759 microversion: 2.1 time: 0.184824 Feb 16 14:31:38.975047 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 404/858] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:38 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1759 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:39.331796 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-14c8cc73-0b32-4444-89a8-e823c3169738 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:39.332399 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-14c8cc73-0b32-4444-89a8-e823c3169738 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:39.339240 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-14c8cc73-0b32-4444-89a8-e823c3169738 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:39.339686 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-14c8cc73-0b32-4444-89a8-e823c3169738 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:39.340518 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-14c8cc73-0b32-4444-89a8-e823c3169738 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:39.340945 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-14c8cc73-0b32-4444-89a8-e823c3169738 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:39.424821 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-14557f1e-2600-4162-b0d1-88eb8407ed75 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:39.425788 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-14557f1e-2600-4162-b0d1-88eb8407ed75 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: b4500f33-6b10-4893-96c9-fb4417e44483] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:39.431968 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-14557f1e-2600-4162-b0d1-88eb8407ed75 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:39.432435 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-14557f1e-2600-4162-b0d1-88eb8407ed75 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:39.433332 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-14557f1e-2600-4162-b0d1-88eb8407ed75 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:39.433715 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-14557f1e-2600-4162-b0d1-88eb8407ed75 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:39.465455 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-14557f1e-2600-4162-b0d1-88eb8407ed75 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044700 Feb 16 14:31:39.466020 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 405/859] 10.222.0.110 () {58 vars in 1306 bytes} [Wed Feb 16 14:31:39 2022] GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 14:31:39.473942 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-14c8cc73-0b32-4444-89a8-e823c3169738 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:39.481836 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-14c8cc73-0b32-4444-89a8-e823c3169738 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:39.483378 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-14c8cc73-0b32-4444-89a8-e823c3169738 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:39.484556 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-14c8cc73-0b32-4444-89a8-e823c3169738 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1723 microversion: 2.20 time: 0.156451 Feb 16 14:31:39.485109 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 455/860] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:31:39 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:31:39.994553 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-08a122bd-79ef-4c3a-a550-b9cfcbe18700 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:39.995200 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-08a122bd-79ef-4c3a-a550-b9cfcbe18700 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:40.001561 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-08a122bd-79ef-4c3a-a550-b9cfcbe18700 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:40.002018 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-08a122bd-79ef-4c3a-a550-b9cfcbe18700 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:40.002837 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-08a122bd-79ef-4c3a-a550-b9cfcbe18700 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:40.003284 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-08a122bd-79ef-4c3a-a550-b9cfcbe18700 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:40.150096 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-08a122bd-79ef-4c3a-a550-b9cfcbe18700 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:40.157914 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-08a122bd-79ef-4c3a-a550-b9cfcbe18700 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1759 microversion: 2.1 time: 0.168919 Feb 16 14:31:40.158469 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 406/861] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:39 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1759 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:40.476818 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-44baa02a-f9ac-4945-ac84-72b67748f524 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:40.477705 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-44baa02a-f9ac-4945-ac84-72b67748f524 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: b4500f33-6b10-4893-96c9-fb4417e44483] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:40.483985 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-44baa02a-f9ac-4945-ac84-72b67748f524 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:40.484436 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-44baa02a-f9ac-4945-ac84-72b67748f524 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:40.485233 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-44baa02a-f9ac-4945-ac84-72b67748f524 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:40.485654 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-44baa02a-f9ac-4945-ac84-72b67748f524 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:40.502190 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c5eaac44-79da-4865-ab8c-2cefb610c8ce tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:40.502831 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c5eaac44-79da-4865-ab8c-2cefb610c8ce tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:40.508633 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c5eaac44-79da-4865-ab8c-2cefb610c8ce tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:40.509810 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c5eaac44-79da-4865-ab8c-2cefb610c8ce tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:40.510601 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c5eaac44-79da-4865-ab8c-2cefb610c8ce tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:40.511104 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c5eaac44-79da-4865-ab8c-2cefb610c8ce tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:40.516162 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-44baa02a-f9ac-4945-ac84-72b67748f524 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043116 Feb 16 14:31:40.516735 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 456/862] 10.222.0.110 () {58 vars in 1306 bytes} [Wed Feb 16 14:31:40 2022] GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:31:40.645225 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c5eaac44-79da-4865-ab8c-2cefb610c8ce tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:40.653030 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c5eaac44-79da-4865-ab8c-2cefb610c8ce tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:40.654546 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c5eaac44-79da-4865-ab8c-2cefb610c8ce tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:40.655763 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c5eaac44-79da-4865-ab8c-2cefb610c8ce tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1723 microversion: 2.20 time: 0.157347 Feb 16 14:31:40.656318 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 407/863] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:31:40 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:31:41.174610 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-394f3276-e8b0-47fb-867b-a7d82161e578 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:41.175236 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-394f3276-e8b0-47fb-867b-a7d82161e578 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:41.181154 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-394f3276-e8b0-47fb-867b-a7d82161e578 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:41.181593 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-394f3276-e8b0-47fb-867b-a7d82161e578 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:41.182476 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-394f3276-e8b0-47fb-867b-a7d82161e578 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:41.182954 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-394f3276-e8b0-47fb-867b-a7d82161e578 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:41.334740 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-394f3276-e8b0-47fb-867b-a7d82161e578 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:41.342998 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-394f3276-e8b0-47fb-867b-a7d82161e578 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1759 microversion: 2.1 time: 0.172000 Feb 16 14:31:41.343557 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 457/864] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:41 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1759 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:41.528854 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c991617c-6de7-44cb-ab16-4befbffa6928 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:41.529819 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c991617c-6de7-44cb-ab16-4befbffa6928 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: b4500f33-6b10-4893-96c9-fb4417e44483] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:41.536424 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c991617c-6de7-44cb-ab16-4befbffa6928 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:41.536871 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c991617c-6de7-44cb-ab16-4befbffa6928 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:41.537639 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c991617c-6de7-44cb-ab16-4befbffa6928 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:41.538104 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c991617c-6de7-44cb-ab16-4befbffa6928 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:41.567169 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c991617c-6de7-44cb-ab16-4befbffa6928 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042773 Feb 16 14:31:41.567722 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 408/865] 10.222.0.110 () {58 vars in 1306 bytes} [Wed Feb 16 14:31:41 2022] GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:31:41.673018 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-5062a2c8-ae31-41d1-96a9-4ca0952e11c7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:41.673625 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-5062a2c8-ae31-41d1-96a9-4ca0952e11c7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:41.679889 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5062a2c8-ae31-41d1-96a9-4ca0952e11c7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:41.681567 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5062a2c8-ae31-41d1-96a9-4ca0952e11c7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:41.681567 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5062a2c8-ae31-41d1-96a9-4ca0952e11c7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:41.681773 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5062a2c8-ae31-41d1-96a9-4ca0952e11c7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:41.815850 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-5062a2c8-ae31-41d1-96a9-4ca0952e11c7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:41.824573 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-5062a2c8-ae31-41d1-96a9-4ca0952e11c7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:41.826099 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-5062a2c8-ae31-41d1-96a9-4ca0952e11c7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:41.827557 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-5062a2c8-ae31-41d1-96a9-4ca0952e11c7 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1723 microversion: 2.20 time: 0.157996 Feb 16 14:31:41.828134 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 458/866] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:31:41 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:31:42.127312 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-2f2ddc7d-51c6-4a96-9054-595cde1a6cb0 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-713989378", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-203474760", "security_groups": [{"name": "tempest-secgroup-smoke-1368858584"}], "block_device_mapping_v2": [{"uuid": "1c376a9d-96f5-4afc-a40a-7320c268fc1b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0af86f90-4507-47db-8c2b-277aef0456a0"}]}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:31:42.235825 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.network.neutron [None req-2f2ddc7d-51c6-4a96-9054-595cde1a6cb0 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] validate_networks() for [('0af86f90-4507-47db-8c2b-277aef0456a0', None, None, None, None, None)] {{(pid=117032) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 16 14:31:42.361358 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-2bb88242-cd8a-452e-93ad-fcf4f1287b3a tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:42.361974 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-2bb88242-cd8a-452e-93ad-fcf4f1287b3a tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:42.369037 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-2bb88242-cd8a-452e-93ad-fcf4f1287b3a tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:42.369510 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-2bb88242-cd8a-452e-93ad-fcf4f1287b3a tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:42.370314 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-2bb88242-cd8a-452e-93ad-fcf4f1287b3a tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:42.370794 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-2bb88242-cd8a-452e-93ad-fcf4f1287b3a tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:42.517877 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-2bb88242-cd8a-452e-93ad-fcf4f1287b3a tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:42.527072 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-2bb88242-cd8a-452e-93ad-fcf4f1287b3a tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1759 microversion: 2.1 time: 0.169306 Feb 16 14:31:42.527651 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 459/867] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:42 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1759 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:31:42.579422 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-9f4d777f-795d-4b65-8d82-ae98ee3b75ed tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:42.580481 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-9f4d777f-795d-4b65-8d82-ae98ee3b75ed tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: b4500f33-6b10-4893-96c9-fb4417e44483] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:42.586644 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9f4d777f-795d-4b65-8d82-ae98ee3b75ed tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:42.587878 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9f4d777f-795d-4b65-8d82-ae98ee3b75ed tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:42.588842 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9f4d777f-795d-4b65-8d82-ae98ee3b75ed tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:42.589374 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9f4d777f-795d-4b65-8d82-ae98ee3b75ed tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:42.619646 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-9f4d777f-795d-4b65-8d82-ae98ee3b75ed tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044760 Feb 16 14:31:42.620379 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 460/868] 10.222.0.110 () {58 vars in 1306 bytes} [Wed Feb 16 14:31:42 2022] GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 14:31:42.706585 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-2f2ddc7d-51c6-4a96-9054-595cde1a6cb0 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Flavor limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 16 14:31:42.707096 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-2f2ddc7d-51c6-4a96-9054-595cde1a6cb0 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Image limits 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 16 14:31:42.707613 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-2f2ddc7d-51c6-4a96-9054-595cde1a6cb0 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Flavor pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 16 14:31:42.708025 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-2f2ddc7d-51c6-4a96-9054-595cde1a6cb0 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Image pref 0:0:0 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 16 14:31:42.714660 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.virt.hardware [None req-2f2ddc7d-51c6-4a96-9054-595cde1a6cb0 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117032) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 16 14:31:42.718280 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2f2ddc7d-51c6-4a96-9054-595cde1a6cb0 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:42.718797 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2f2ddc7d-51c6-4a96-9054-595cde1a6cb0 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:42.722264 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2f2ddc7d-51c6-4a96-9054-595cde1a6cb0 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:42.722264 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2f2ddc7d-51c6-4a96-9054-595cde1a6cb0 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:42.737016 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-2f2ddc7d-51c6-4a96-9054-595cde1a6cb0 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Getting quotas for project a072f4cf28da4e14b3fd13b1ba2a9686. Resources: {'cores', 'instances', 'ram'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 14:31:42.740958 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.quota [None req-2f2ddc7d-51c6-4a96-9054-595cde1a6cb0 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Getting quotas for user 44f75877ea98492e95bfe67b250891e6 and project a072f4cf28da4e14b3fd13b1ba2a9686. Resources: {'cores', 'instances', 'ram'} {{(pid=117032) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 14:31:42.796252 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-2f2ddc7d-51c6-4a96-9054-595cde1a6cb0 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Going to run 1 instances... {{(pid=117032) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 16 14:31:42.798577 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-2f2ddc7d-51c6-4a96-9054-595cde1a6cb0 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: cc0fdcf7-b856-43f5-b061-b03d687c327f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1c376a9d-96f5-4afc-a40a-7320c268fc1b',volume_size=None,volume_type=None)] {{(pid=117032) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 16 14:31:42.846276 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-033502d2-a477-41f4-a73d-ecc6e4dfeafe tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:42.846897 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-033502d2-a477-41f4-a73d-ecc6e4dfeafe tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:42.853554 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-033502d2-a477-41f4-a73d-ecc6e4dfeafe tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:42.854002 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-033502d2-a477-41f4-a73d-ecc6e4dfeafe tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:42.854807 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-033502d2-a477-41f4-a73d-ecc6e4dfeafe tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:42.855338 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-033502d2-a477-41f4-a73d-ecc6e4dfeafe tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:42.997519 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-033502d2-a477-41f4-a73d-ecc6e4dfeafe tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:43.005356 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-033502d2-a477-41f4-a73d-ecc6e4dfeafe tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:43.006893 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-033502d2-a477-41f4-a73d-ecc6e4dfeafe tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:43.008043 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-033502d2-a477-41f4-a73d-ecc6e4dfeafe tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1723 microversion: 2.20 time: 0.165692 Feb 16 14:31:43.008628 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 461/869] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:31:42 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:31:43.191490 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-2f2ddc7d-51c6-4a96-9054-595cde1a6cb0 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.067760 Feb 16 14:31:43.192115 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 409/870] 10.222.0.110 () {60 vars in 1151 bytes} [Wed Feb 16 14:31:42 2022] POST /compute/v2.1/servers => generated 408 bytes in 1069 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Feb 16 14:31:43.202245 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-e84347b5-877c-458e-a786-29dfce8372ee tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:43.203031 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-e84347b5-877c-458e-a786-29dfce8372ee tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: cc0fdcf7-b856-43f5-b061-b03d687c327f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:43.253985 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-e84347b5-877c-458e-a786-29dfce8372ee tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:43.260580 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-e84347b5-877c-458e-a786-29dfce8372ee tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f" status: 200 len: 1096 microversion: 2.1 time: 0.062464 Feb 16 14:31:43.261144 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 462/871] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:43 2022] GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f => generated 1096 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:43.544261 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-2f22803c-d4af-4721-b07f-16a5dcbbded3 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:43.545499 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-2f22803c-d4af-4721-b07f-16a5dcbbded3 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:43.552614 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2f22803c-d4af-4721-b07f-16a5dcbbded3 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:43.553068 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2f22803c-d4af-4721-b07f-16a5dcbbded3 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:43.553865 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2f22803c-d4af-4721-b07f-16a5dcbbded3 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:43.559421 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2f22803c-d4af-4721-b07f-16a5dcbbded3 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:43.631817 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-0c1637d6-c446-457b-a5d5-68322654b004 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:43.632895 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-0c1637d6-c446-457b-a5d5-68322654b004 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: b4500f33-6b10-4893-96c9-fb4417e44483] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:43.639833 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0c1637d6-c446-457b-a5d5-68322654b004 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:43.642614 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0c1637d6-c446-457b-a5d5-68322654b004 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:43.642614 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0c1637d6-c446-457b-a5d5-68322654b004 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:43.642614 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0c1637d6-c446-457b-a5d5-68322654b004 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:43.683254 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-0c1637d6-c446-457b-a5d5-68322654b004 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055223 Feb 16 14:31:43.683844 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 463/872] 10.222.0.110 () {58 vars in 1306 bytes} [Wed Feb 16 14:31:43 2022] GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 14:31:43.710186 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-2f22803c-d4af-4721-b07f-16a5dcbbded3 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:43.719276 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-2f22803c-d4af-4721-b07f-16a5dcbbded3 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1759 microversion: 2.1 time: 0.179299 Feb 16 14:31:43.720049 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 410/873] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:43 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1759 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:43.829357 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-5871eaa4-8a44-4795-ba0a-c23b004458a3 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:43.830262 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-5871eaa4-8a44-4795-ba0a-c23b004458a3 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:43.836297 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5871eaa4-8a44-4795-ba0a-c23b004458a3 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:43.837573 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5871eaa4-8a44-4795-ba0a-c23b004458a3 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:43.838414 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5871eaa4-8a44-4795-ba0a-c23b004458a3 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:43.838882 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5871eaa4-8a44-4795-ba0a-c23b004458a3 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:43.867992 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-5871eaa4-8a44-4795-ba0a-c23b004458a3 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042727 Feb 16 14:31:43.868626 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 464/874] 10.222.0.110 () {58 vars in 1306 bytes} [Wed Feb 16 14:31:43 2022] GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:31:44.025577 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b83bf24c-6f13-4708-99bc-6d754bbcb3ee tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:44.026196 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b83bf24c-6f13-4708-99bc-6d754bbcb3ee tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:44.032171 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b83bf24c-6f13-4708-99bc-6d754bbcb3ee tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:44.032667 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b83bf24c-6f13-4708-99bc-6d754bbcb3ee tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:44.033441 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b83bf24c-6f13-4708-99bc-6d754bbcb3ee tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:44.033905 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b83bf24c-6f13-4708-99bc-6d754bbcb3ee tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:44.177545 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b83bf24c-6f13-4708-99bc-6d754bbcb3ee tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:44.185733 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b83bf24c-6f13-4708-99bc-6d754bbcb3ee tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:44.187314 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b83bf24c-6f13-4708-99bc-6d754bbcb3ee tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:44.188477 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b83bf24c-6f13-4708-99bc-6d754bbcb3ee tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1723 microversion: 2.20 time: 0.166822 Feb 16 14:31:44.189152 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 411/875] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:31:44 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:31:44.277624 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-3610ea11-3044-4a7d-a6c4-93392d752006 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:44.282289 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-3610ea11-3044-4a7d-a6c4-93392d752006 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: cc0fdcf7-b856-43f5-b061-b03d687c327f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:44.329341 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-3610ea11-3044-4a7d-a6c4-93392d752006 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:44.336129 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-3610ea11-3044-4a7d-a6c4-93392d752006 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f" status: 200 len: 1096 microversion: 2.1 time: 0.063407 Feb 16 14:31:44.337235 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 465/876] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:44 2022] GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f => generated 1096 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:44.696853 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ec5ea0c7-9cf6-4a3c-9040-8f33935b1277 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:44.697785 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ec5ea0c7-9cf6-4a3c-9040-8f33935b1277 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: b4500f33-6b10-4893-96c9-fb4417e44483] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:44.704777 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ec5ea0c7-9cf6-4a3c-9040-8f33935b1277 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:44.705248 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ec5ea0c7-9cf6-4a3c-9040-8f33935b1277 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:44.706035 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ec5ea0c7-9cf6-4a3c-9040-8f33935b1277 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:44.706478 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ec5ea0c7-9cf6-4a3c-9040-8f33935b1277 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:44.735900 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-e290ab04-92f0-4f74-9082-f7d7f91b680f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:44.736510 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-e290ab04-92f0-4f74-9082-f7d7f91b680f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:44.736660 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ec5ea0c7-9cf6-4a3c-9040-8f33935b1277 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044369 Feb 16 14:31:44.737489 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 412/877] 10.222.0.110 () {58 vars in 1306 bytes} [Wed Feb 16 14:31:44 2022] GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 16 14:31:44.742323 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e290ab04-92f0-4f74-9082-f7d7f91b680f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:44.742819 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e290ab04-92f0-4f74-9082-f7d7f91b680f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:44.744060 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e290ab04-92f0-4f74-9082-f7d7f91b680f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:44.744502 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e290ab04-92f0-4f74-9082-f7d7f91b680f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:44.899553 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-e290ab04-92f0-4f74-9082-f7d7f91b680f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:44.907487 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-e290ab04-92f0-4f74-9082-f7d7f91b680f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1759 microversion: 2.1 time: 0.175210 Feb 16 14:31:44.908059 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 466/878] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:44 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1759 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:45.207060 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-10a20ffb-22c2-447f-a12c-627004216659 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:45.207676 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-10a20ffb-22c2-447f-a12c-627004216659 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:45.213565 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-10a20ffb-22c2-447f-a12c-627004216659 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:45.214020 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-10a20ffb-22c2-447f-a12c-627004216659 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:45.214848 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-10a20ffb-22c2-447f-a12c-627004216659 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:45.215289 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-10a20ffb-22c2-447f-a12c-627004216659 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:45.347044 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-10a20ffb-22c2-447f-a12c-627004216659 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:45.353652 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-3a85d8b7-bee5-4cf7-a47f-3c84e383e132 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:45.354265 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-3a85d8b7-bee5-4cf7-a47f-3c84e383e132 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: cc0fdcf7-b856-43f5-b061-b03d687c327f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:45.356078 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-10a20ffb-22c2-447f-a12c-627004216659 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:45.357714 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-10a20ffb-22c2-447f-a12c-627004216659 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:45.359070 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-10a20ffb-22c2-447f-a12c-627004216659 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1723 microversion: 2.20 time: 0.155646 Feb 16 14:31:45.360263 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 413/879] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:31:45 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:31:45.365539 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3a85d8b7-bee5-4cf7-a47f-3c84e383e132 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:45.365995 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3a85d8b7-bee5-4cf7-a47f-3c84e383e132 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:45.366985 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3a85d8b7-bee5-4cf7-a47f-3c84e383e132 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:45.367295 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3a85d8b7-bee5-4cf7-a47f-3c84e383e132 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:45.449181 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-3a85d8b7-bee5-4cf7-a47f-3c84e383e132 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:45.461021 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-3a85d8b7-bee5-4cf7-a47f-3c84e383e132 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f" status: 200 len: 1194 microversion: 2.1 time: 0.111624 Feb 16 14:31:45.461640 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 467/880] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:45 2022] GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f => generated 1194 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:31:45.923879 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-0ab73133-4f47-40e3-a70b-d2ade3a6e1fa tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:45.924485 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-0ab73133-4f47-40e3-a70b-d2ade3a6e1fa tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:45.931085 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0ab73133-4f47-40e3-a70b-d2ade3a6e1fa tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:45.931308 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0ab73133-4f47-40e3-a70b-d2ade3a6e1fa tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:45.932085 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0ab73133-4f47-40e3-a70b-d2ade3a6e1fa tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:45.932525 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0ab73133-4f47-40e3-a70b-d2ade3a6e1fa tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:46.078775 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-260dd7df-0554-4abc-a2c0-62bbbd819d0f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:46.079347 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-260dd7df-0554-4abc-a2c0-62bbbd819d0f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: b4500f33-6b10-4893-96c9-fb4417e44483] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:46.085957 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-260dd7df-0554-4abc-a2c0-62bbbd819d0f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:46.086415 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-260dd7df-0554-4abc-a2c0-62bbbd819d0f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:46.087262 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-260dd7df-0554-4abc-a2c0-62bbbd819d0f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:46.087741 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-260dd7df-0554-4abc-a2c0-62bbbd819d0f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:46.114240 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-260dd7df-0554-4abc-a2c0-62bbbd819d0f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: b4500f33-6b10-4893-96c9-fb4417e44483] Going to try to terminate instance {{(pid=117031) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 16 14:31:46.192967 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-0ab73133-4f47-40e3-a70b-d2ade3a6e1fa tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:46.201312 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-0ab73133-4f47-40e3-a70b-d2ade3a6e1fa tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1759 microversion: 2.1 time: 0.281147 Feb 16 14:31:46.209458 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 414/881] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:45 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1759 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:46.377264 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-0a8338c3-6935-4d3d-80ea-5fd1f6de61bb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:46.377982 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-0a8338c3-6935-4d3d-80ea-5fd1f6de61bb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:46.383754 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0a8338c3-6935-4d3d-80ea-5fd1f6de61bb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:46.384196 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0a8338c3-6935-4d3d-80ea-5fd1f6de61bb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:46.385531 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0a8338c3-6935-4d3d-80ea-5fd1f6de61bb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:46.385967 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0a8338c3-6935-4d3d-80ea-5fd1f6de61bb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:46.402460 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-260dd7df-0554-4abc-a2c0-62bbbd819d0f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "DELETE /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483" status: 204 len: 0 microversion: 2.1 time: 0.325760 Feb 16 14:31:46.404145 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 468/882] 10.222.0.110 () {58 vars in 1243 bytes} [Wed Feb 16 14:31:46 2022] DELETE /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 16 14:31:46.413044 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-ab4a63fe-13cb-4a74-9d83-63d2054d34be tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:46.413829 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-ab4a63fe-13cb-4a74-9d83-63d2054d34be tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: b4500f33-6b10-4893-96c9-fb4417e44483] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:46.420067 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ab4a63fe-13cb-4a74-9d83-63d2054d34be tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:46.420489 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ab4a63fe-13cb-4a74-9d83-63d2054d34be tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:46.421277 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ab4a63fe-13cb-4a74-9d83-63d2054d34be tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:46.421740 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ab4a63fe-13cb-4a74-9d83-63d2054d34be tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:46.577417 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-ab4a63fe-13cb-4a74-9d83-63d2054d34be tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:46.586193 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-ab4a63fe-13cb-4a74-9d83-63d2054d34be tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483" status: 200 len: 1519 microversion: 2.1 time: 0.177475 Feb 16 14:31:46.587014 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 469/883] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:46 2022] GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483 => generated 1519 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:31:46.595275 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-49e4535c-d7b5-4c5f-a602-f5ce360ccc40 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:46.595275 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-49e4535c-d7b5-4c5f-a602-f5ce360ccc40 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: cc0fdcf7-b856-43f5-b061-b03d687c327f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:46.599985 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-49e4535c-d7b5-4c5f-a602-f5ce360ccc40 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:46.600658 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-49e4535c-d7b5-4c5f-a602-f5ce360ccc40 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:46.601622 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-49e4535c-d7b5-4c5f-a602-f5ce360ccc40 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:46.602052 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-49e4535c-d7b5-4c5f-a602-f5ce360ccc40 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:46.633374 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-0a8338c3-6935-4d3d-80ea-5fd1f6de61bb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:46.642498 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-0a8338c3-6935-4d3d-80ea-5fd1f6de61bb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:46.644383 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-0a8338c3-6935-4d3d-80ea-5fd1f6de61bb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:46.645548 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-0a8338c3-6935-4d3d-80ea-5fd1f6de61bb tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1723 microversion: 2.20 time: 0.272204 Feb 16 14:31:46.646291 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 415/884] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:31:46 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1723 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:31:46.752736 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-49e4535c-d7b5-4c5f-a602-f5ce360ccc40 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:46.760240 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-49e4535c-d7b5-4c5f-a602-f5ce360ccc40 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f" status: 200 len: 1280 microversion: 2.1 time: 0.171879 Feb 16 14:31:46.760992 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 470/885] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:46 2022] GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f => generated 1280 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:47.219492 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-1e6c7e45-e310-425f-a6fd-093bdb82e0d4 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:47.220788 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-1e6c7e45-e310-425f-a6fd-093bdb82e0d4 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:47.227705 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1e6c7e45-e310-425f-a6fd-093bdb82e0d4 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:47.229616 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1e6c7e45-e310-425f-a6fd-093bdb82e0d4 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:47.231262 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1e6c7e45-e310-425f-a6fd-093bdb82e0d4 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:47.232020 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1e6c7e45-e310-425f-a6fd-093bdb82e0d4 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:47.482977 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-1e6c7e45-e310-425f-a6fd-093bdb82e0d4 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:47.491056 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-1e6c7e45-e310-425f-a6fd-093bdb82e0d4 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1759 microversion: 2.1 time: 0.275572 Feb 16 14:31:47.494659 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 416/886] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:47 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1759 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:47.603603 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-01aded4e-4faf-4d13-8765-ebb5288dfd37 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:47.604276 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-01aded4e-4faf-4d13-8765-ebb5288dfd37 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: b4500f33-6b10-4893-96c9-fb4417e44483] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:47.610781 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-01aded4e-4faf-4d13-8765-ebb5288dfd37 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:47.611259 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-01aded4e-4faf-4d13-8765-ebb5288dfd37 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:47.612047 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-01aded4e-4faf-4d13-8765-ebb5288dfd37 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:47.612486 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-01aded4e-4faf-4d13-8765-ebb5288dfd37 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:47.665412 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-b0fa963a-25a5-4e1d-93d4-b15ca6c58845 req-e02f615e-466a-4fca-a553-9415806cb775 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc0fdcf7-b856-43f5-b061-b03d687c327f", "tag": "14aabd43-ae85-477e-98bf-28c418d8f834"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:31:47.668433 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:31:47.668433 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: warnings.warn(msg) Feb 16 14:31:47.685502 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-b0fa963a-25a5-4e1d-93d4-b15ca6c58845 req-e02f615e-466a-4fca-a553-9415806cb775 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:47.695177 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-b0fa963a-25a5-4e1d-93d4-b15ca6c58845 req-e02f615e-466a-4fca-a553-9415806cb775 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:47.711104 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-b0fa963a-25a5-4e1d-93d4-b15ca6c58845 req-e02f615e-466a-4fca-a553-9415806cb775 service nova] Creating event network-changed:14aabd43-ae85-477e-98bf-28c418d8f834 for instance cc0fdcf7-b856-43f5-b061-b03d687c327f on hv-cinder-80473 Feb 16 14:31:47.718004 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-b0fa963a-25a5-4e1d-93d4-b15ca6c58845 req-e02f615e-466a-4fca-a553-9415806cb775 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056481 Feb 16 14:31:47.718599 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 417/887] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:31:47.727219 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-43cd26a9-151c-49a9-8728-a0be01692ae8 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:47.727959 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-43cd26a9-151c-49a9-8728-a0be01692ae8 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:47.737130 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-43cd26a9-151c-49a9-8728-a0be01692ae8 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:47.737799 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-43cd26a9-151c-49a9-8728-a0be01692ae8 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:47.739090 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-43cd26a9-151c-49a9-8728-a0be01692ae8 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:47.739807 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-43cd26a9-151c-49a9-8728-a0be01692ae8 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:47.763152 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-01aded4e-4faf-4d13-8765-ebb5288dfd37 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:47.771926 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-01aded4e-4faf-4d13-8765-ebb5288dfd37 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483" status: 200 len: 1519 microversion: 2.1 time: 0.171959 Feb 16 14:31:47.775583 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 471/888] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:47 2022] GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483 => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:47.778480 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-54108d78-6511-4203-875a-5afcdda1b2ec tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:47.779280 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-54108d78-6511-4203-875a-5afcdda1b2ec tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: cc0fdcf7-b856-43f5-b061-b03d687c327f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:47.785777 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-54108d78-6511-4203-875a-5afcdda1b2ec tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:47.786484 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-54108d78-6511-4203-875a-5afcdda1b2ec tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:47.787506 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-54108d78-6511-4203-875a-5afcdda1b2ec tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:47.788094 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-54108d78-6511-4203-875a-5afcdda1b2ec tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:47.937809 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-54108d78-6511-4203-875a-5afcdda1b2ec tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:47.945112 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-54108d78-6511-4203-875a-5afcdda1b2ec tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f" status: 200 len: 1268 microversion: 2.1 time: 0.170770 Feb 16 14:31:47.945681 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 472/889] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:47 2022] GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f => generated 1268 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:47.965225 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-43cd26a9-151c-49a9-8728-a0be01692ae8 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:47.973320 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-43cd26a9-151c-49a9-8728-a0be01692ae8 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:47.974950 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-43cd26a9-151c-49a9-8728-a0be01692ae8 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:47.976216 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-43cd26a9-151c-49a9-8728-a0be01692ae8 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1723 microversion: 2.20 time: 0.255439 Feb 16 14:31:47.976853 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 418/890] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:31:47 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1723 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:31:48.508074 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-fd3f1501-20cf-4b88-b6b4-b2cbfb064e54 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:48.508681 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-fd3f1501-20cf-4b88-b6b4-b2cbfb064e54 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:48.515186 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-fd3f1501-20cf-4b88-b6b4-b2cbfb064e54 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:48.515672 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-fd3f1501-20cf-4b88-b6b4-b2cbfb064e54 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:48.516461 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-fd3f1501-20cf-4b88-b6b4-b2cbfb064e54 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:48.516897 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-fd3f1501-20cf-4b88-b6b4-b2cbfb064e54 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:48.664406 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-fd3f1501-20cf-4b88-b6b4-b2cbfb064e54 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:48.673896 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-fd3f1501-20cf-4b88-b6b4-b2cbfb064e54 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1759 microversion: 2.1 time: 0.169415 Feb 16 14:31:48.674477 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 473/891] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:48 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1759 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:48.789162 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-79ed70e8-7b01-4825-a909-1b115bfacc78 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:48.789810 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-79ed70e8-7b01-4825-a909-1b115bfacc78 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: b4500f33-6b10-4893-96c9-fb4417e44483] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:48.796615 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-79ed70e8-7b01-4825-a909-1b115bfacc78 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:48.797075 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-79ed70e8-7b01-4825-a909-1b115bfacc78 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:48.797905 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-79ed70e8-7b01-4825-a909-1b115bfacc78 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:48.798353 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-79ed70e8-7b01-4825-a909-1b115bfacc78 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:48.931059 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-79ed70e8-7b01-4825-a909-1b115bfacc78 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:48.938651 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-79ed70e8-7b01-4825-a909-1b115bfacc78 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483" status: 200 len: 1519 microversion: 2.1 time: 0.153166 Feb 16 14:31:48.941629 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 419/892] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:48 2022] GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:48.962688 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-8af8e951-284e-4b85-a020-ce0161c84896 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:48.964402 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-8af8e951-284e-4b85-a020-ce0161c84896 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: cc0fdcf7-b856-43f5-b061-b03d687c327f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:48.970358 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8af8e951-284e-4b85-a020-ce0161c84896 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:48.970859 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8af8e951-284e-4b85-a020-ce0161c84896 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:48.971686 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8af8e951-284e-4b85-a020-ce0161c84896 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:48.972130 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8af8e951-284e-4b85-a020-ce0161c84896 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:48.995036 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-456738af-aa17-4937-bb39-a065ecb77d18 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:48.995675 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-456738af-aa17-4937-bb39-a065ecb77d18 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:49.001615 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-456738af-aa17-4937-bb39-a065ecb77d18 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:49.002074 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-456738af-aa17-4937-bb39-a065ecb77d18 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:49.002896 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-456738af-aa17-4937-bb39-a065ecb77d18 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:49.003344 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-456738af-aa17-4937-bb39-a065ecb77d18 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:49.111962 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-8af8e951-284e-4b85-a020-ce0161c84896 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:49.120056 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-8af8e951-284e-4b85-a020-ce0161c84896 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f" status: 200 len: 1268 microversion: 2.1 time: 0.160726 Feb 16 14:31:49.120790 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 474/893] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:48 2022] GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:49.181926 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-456738af-aa17-4937-bb39-a065ecb77d18 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:49.189772 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-456738af-aa17-4937-bb39-a065ecb77d18 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:49.191351 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-456738af-aa17-4937-bb39-a065ecb77d18 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:49.192512 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-456738af-aa17-4937-bb39-a065ecb77d18 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1723 microversion: 2.20 time: 0.201262 Feb 16 14:31:49.193072 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 420/894] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:31:48 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:31:49.691112 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-b9c41eca-8368-4ade-9122-cf960ba2d094 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:49.691743 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-b9c41eca-8368-4ade-9122-cf960ba2d094 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:49.697996 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b9c41eca-8368-4ade-9122-cf960ba2d094 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:49.699724 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b9c41eca-8368-4ade-9122-cf960ba2d094 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:49.699724 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b9c41eca-8368-4ade-9122-cf960ba2d094 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:49.699724 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b9c41eca-8368-4ade-9122-cf960ba2d094 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:49.735986 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-066f3488-9468-4f2f-a66e-a7e7f8ab85c2 req-4841641f-23ec-4f3d-9046-4f4b7a128901 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4500f33-6b10-4893-96c9-fb4417e44483", "name": "network-vif-deleted", "tag": "de6937e7-2d6b-499a-b10e-87f05040921a"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:31:49.743725 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:31:49.743725 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: warnings.warn(msg) Feb 16 14:31:49.750843 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-066f3488-9468-4f2f-a66e-a7e7f8ab85c2 req-4841641f-23ec-4f3d-9046-4f4b7a128901 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:49.751311 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-066f3488-9468-4f2f-a66e-a7e7f8ab85c2 req-4841641f-23ec-4f3d-9046-4f4b7a128901 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:49.763544 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-066f3488-9468-4f2f-a66e-a7e7f8ab85c2 req-4841641f-23ec-4f3d-9046-4f4b7a128901 service nova] Creating event network-vif-deleted:de6937e7-2d6b-499a-b10e-87f05040921a for instance b4500f33-6b10-4893-96c9-fb4417e44483 on hv-cinder-80473 Feb 16 14:31:49.769671 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-066f3488-9468-4f2f-a66e-a7e7f8ab85c2 req-4841641f-23ec-4f3d-9046-4f4b7a128901 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038595 Feb 16 14:31:49.774935 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 421/895] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:31:49.856811 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-b9c41eca-8368-4ade-9122-cf960ba2d094 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:49.866318 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-b9c41eca-8368-4ade-9122-cf960ba2d094 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1759 microversion: 2.1 time: 0.178979 Feb 16 14:31:49.866961 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 475/896] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:49 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1759 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:49.955976 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-faaa19bd-ada5-4e72-8d5a-c6e46f0c1ef2 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:49.956683 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-faaa19bd-ada5-4e72-8d5a-c6e46f0c1ef2 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: b4500f33-6b10-4893-96c9-fb4417e44483] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:49.963503 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-faaa19bd-ada5-4e72-8d5a-c6e46f0c1ef2 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:49.964128 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-faaa19bd-ada5-4e72-8d5a-c6e46f0c1ef2 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:49.964976 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-faaa19bd-ada5-4e72-8d5a-c6e46f0c1ef2 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:49.965365 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-faaa19bd-ada5-4e72-8d5a-c6e46f0c1ef2 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:50.033255 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-faaa19bd-ada5-4e72-8d5a-c6e46f0c1ef2 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:50.039204 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-faaa19bd-ada5-4e72-8d5a-c6e46f0c1ef2 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483" status: 200 len: 1307 microversion: 2.1 time: 0.087197 Feb 16 14:31:50.040306 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 422/897] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:49 2022] GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483 => generated 1307 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:50.136567 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-0573d24a-f0d2-41b0-9740-bb4cfe6a624f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:50.137167 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-0573d24a-f0d2-41b0-9740-bb4cfe6a624f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: cc0fdcf7-b856-43f5-b061-b03d687c327f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:50.143024 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0573d24a-f0d2-41b0-9740-bb4cfe6a624f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:50.143470 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0573d24a-f0d2-41b0-9740-bb4cfe6a624f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:50.144238 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0573d24a-f0d2-41b0-9740-bb4cfe6a624f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:50.144667 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0573d24a-f0d2-41b0-9740-bb4cfe6a624f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:50.211804 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-3f103c20-2da2-4bb1-be6b-92c2e16715f1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:50.212411 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-3f103c20-2da2-4bb1-be6b-92c2e16715f1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:50.218881 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3f103c20-2da2-4bb1-be6b-92c2e16715f1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:50.219333 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3f103c20-2da2-4bb1-be6b-92c2e16715f1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:50.220109 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3f103c20-2da2-4bb1-be6b-92c2e16715f1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:50.220543 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3f103c20-2da2-4bb1-be6b-92c2e16715f1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:50.281014 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-0573d24a-f0d2-41b0-9740-bb4cfe6a624f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:50.288277 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-0573d24a-f0d2-41b0-9740-bb4cfe6a624f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f" status: 200 len: 1268 microversion: 2.1 time: 0.155376 Feb 16 14:31:50.288842 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 476/898] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:50 2022] GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:50.352170 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3f103c20-2da2-4bb1-be6b-92c2e16715f1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:50.360599 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3f103c20-2da2-4bb1-be6b-92c2e16715f1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:50.362101 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3f103c20-2da2-4bb1-be6b-92c2e16715f1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:50.363315 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-3f103c20-2da2-4bb1-be6b-92c2e16715f1 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1723 microversion: 2.20 time: 0.155320 Feb 16 14:31:50.363918 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 423/899] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:31:50 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:31:50.883912 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-ef0a1319-2a4c-47d6-a500-389a744604b6 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:50.884551 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-ef0a1319-2a4c-47d6-a500-389a744604b6 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:50.890779 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ef0a1319-2a4c-47d6-a500-389a744604b6 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:50.891218 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ef0a1319-2a4c-47d6-a500-389a744604b6 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:50.891987 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ef0a1319-2a4c-47d6-a500-389a744604b6 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:50.892415 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ef0a1319-2a4c-47d6-a500-389a744604b6 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:51.038712 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-ef0a1319-2a4c-47d6-a500-389a744604b6 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:51.047434 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-ef0a1319-2a4c-47d6-a500-389a744604b6 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1759 microversion: 2.1 time: 0.167239 Feb 16 14:31:51.047999 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 477/900] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:50 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1759 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:51.056886 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-2416f21c-fc1e-4627-b502-06a25e513da1 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:51.063087 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-2416f21c-fc1e-4627-b502-06a25e513da1 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: b4500f33-6b10-4893-96c9-fb4417e44483] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:51.063915 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2416f21c-fc1e-4627-b502-06a25e513da1 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:51.064376 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2416f21c-fc1e-4627-b502-06a25e513da1 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:51.065165 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2416f21c-fc1e-4627-b502-06a25e513da1 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:51.065609 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2416f21c-fc1e-4627-b502-06a25e513da1 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:51.079135 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-2416f21c-fc1e-4627-b502-06a25e513da1 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] HTTP exception thrown: Instance b4500f33-6b10-4893-96c9-fb4417e44483 could not be found. Feb 16 14:31:51.079726 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-2416f21c-fc1e-4627-b502-06a25e513da1 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Returning 404 to user: Instance b4500f33-6b10-4893-96c9-fb4417e44483 could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:31:51.080548 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-2416f21c-fc1e-4627-b502-06a25e513da1 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483" status: 404 len: 111 microversion: 2.1 time: 0.027367 Feb 16 14:31:51.081076 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 424/901] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:51 2022] GET /compute/v2.1/servers/b4500f33-6b10-4893-96c9-fb4417e44483 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 14:31:51.304953 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-45111faf-0e9e-4568-b664-e20e80e71f1b tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:51.305556 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-45111faf-0e9e-4568-b664-e20e80e71f1b tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: cc0fdcf7-b856-43f5-b061-b03d687c327f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:51.312011 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-45111faf-0e9e-4568-b664-e20e80e71f1b tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:51.312492 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-45111faf-0e9e-4568-b664-e20e80e71f1b tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:51.313304 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-45111faf-0e9e-4568-b664-e20e80e71f1b tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:51.313735 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-45111faf-0e9e-4568-b664-e20e80e71f1b tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:51.382177 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-0a48f2bf-7a36-4c43-bc97-3f8445244783 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:51.383188 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-0a48f2bf-7a36-4c43-bc97-3f8445244783 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:51.390255 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0a48f2bf-7a36-4c43-bc97-3f8445244783 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:51.390754 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0a48f2bf-7a36-4c43-bc97-3f8445244783 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:51.391561 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0a48f2bf-7a36-4c43-bc97-3f8445244783 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:51.392008 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0a48f2bf-7a36-4c43-bc97-3f8445244783 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:51.466493 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-45111faf-0e9e-4568-b664-e20e80e71f1b tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:51.473846 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-45111faf-0e9e-4568-b664-e20e80e71f1b tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f" status: 200 len: 1268 microversion: 2.1 time: 0.172562 Feb 16 14:31:51.474451 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 478/902] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:51 2022] GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f => generated 1268 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:51.534128 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-0a48f2bf-7a36-4c43-bc97-3f8445244783 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:51.542836 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-0a48f2bf-7a36-4c43-bc97-3f8445244783 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:51.544345 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-0a48f2bf-7a36-4c43-bc97-3f8445244783 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:51.545563 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-0a48f2bf-7a36-4c43-bc97-3f8445244783 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1723 microversion: 2.20 time: 0.167546 Feb 16 14:31:51.546057 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 425/903] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:31:51 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:31:52.063970 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-b02a04ae-144f-4402-99dc-b6eb58ce79c6 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:52.064581 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-b02a04ae-144f-4402-99dc-b6eb58ce79c6 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:52.071147 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b02a04ae-144f-4402-99dc-b6eb58ce79c6 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:52.071598 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b02a04ae-144f-4402-99dc-b6eb58ce79c6 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:52.073152 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b02a04ae-144f-4402-99dc-b6eb58ce79c6 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:52.073979 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b02a04ae-144f-4402-99dc-b6eb58ce79c6 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:52.219472 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-b02a04ae-144f-4402-99dc-b6eb58ce79c6 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:52.227226 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-b02a04ae-144f-4402-99dc-b6eb58ce79c6 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1759 microversion: 2.1 time: 0.166989 Feb 16 14:31:52.227794 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 479/904] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:52 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1759 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:52.372171 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a76b9578-a13b-4fe9-82f5-452859eeab2e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:52.372752 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a76b9578-a13b-4fe9-82f5-452859eeab2e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f07b0b32-9726-4fef-b3d7-31da2f0ca96f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:52.379367 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a76b9578-a13b-4fe9-82f5-452859eeab2e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:52.379909 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a76b9578-a13b-4fe9-82f5-452859eeab2e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:52.380692 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a76b9578-a13b-4fe9-82f5-452859eeab2e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:52.381133 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a76b9578-a13b-4fe9-82f5-452859eeab2e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:52.407551 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a76b9578-a13b-4fe9-82f5-452859eeab2e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f07b0b32-9726-4fef-b3d7-31da2f0ca96f] Going to try to terminate instance {{(pid=117032) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 16 14:31:52.491149 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-58dbeb60-270d-4ad9-b6b0-c235bbf85fee tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:52.491790 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-58dbeb60-270d-4ad9-b6b0-c235bbf85fee tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: cc0fdcf7-b856-43f5-b061-b03d687c327f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:52.498329 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-58dbeb60-270d-4ad9-b6b0-c235bbf85fee tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:52.498803 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-58dbeb60-270d-4ad9-b6b0-c235bbf85fee tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:52.499577 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-58dbeb60-270d-4ad9-b6b0-c235bbf85fee tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:52.500005 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-58dbeb60-270d-4ad9-b6b0-c235bbf85fee tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:52.634509 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-58dbeb60-270d-4ad9-b6b0-c235bbf85fee tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:52.642607 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-58dbeb60-270d-4ad9-b6b0-c235bbf85fee tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f" status: 200 len: 1268 microversion: 2.1 time: 0.155209 Feb 16 14:31:52.643205 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 480/905] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:52 2022] GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:31:52.647424 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-875d11d4-bb9d-44b2-87e8-24cd5b571331 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:52.648016 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-875d11d4-bb9d-44b2-87e8-24cd5b571331 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:52.653793 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-875d11d4-bb9d-44b2-87e8-24cd5b571331 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:52.654238 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-875d11d4-bb9d-44b2-87e8-24cd5b571331 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:52.655040 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-875d11d4-bb9d-44b2-87e8-24cd5b571331 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:52.655526 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-875d11d4-bb9d-44b2-87e8-24cd5b571331 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:52.709969 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a76b9578-a13b-4fe9-82f5-452859eeab2e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "DELETE /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f" status: 204 len: 0 microversion: 2.1 time: 0.342094 Feb 16 14:31:52.710591 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 426/906] 10.222.0.110 () {58 vars in 1243 bytes} [Wed Feb 16 14:31:52 2022] DELETE /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 16 14:31:52.718667 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-afc0a439-7f12-4a4a-b5e5-e76061c29a3f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:52.719479 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-afc0a439-7f12-4a4a-b5e5-e76061c29a3f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f07b0b32-9726-4fef-b3d7-31da2f0ca96f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:52.725691 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-afc0a439-7f12-4a4a-b5e5-e76061c29a3f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:52.726143 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-afc0a439-7f12-4a4a-b5e5-e76061c29a3f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:52.727031 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-afc0a439-7f12-4a4a-b5e5-e76061c29a3f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:52.727466 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-afc0a439-7f12-4a4a-b5e5-e76061c29a3f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:52.788341 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-875d11d4-bb9d-44b2-87e8-24cd5b571331 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:52.796820 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-875d11d4-bb9d-44b2-87e8-24cd5b571331 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:52.798339 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-875d11d4-bb9d-44b2-87e8-24cd5b571331 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:52.799519 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-875d11d4-bb9d-44b2-87e8-24cd5b571331 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1723 microversion: 2.20 time: 0.155410 Feb 16 14:31:52.800086 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 481/907] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:31:52 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:31:52.863292 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-afc0a439-7f12-4a4a-b5e5-e76061c29a3f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:52.871013 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-afc0a439-7f12-4a4a-b5e5-e76061c29a3f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f" status: 200 len: 1518 microversion: 2.1 time: 0.156189 Feb 16 14:31:52.871583 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 427/908] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:52 2022] GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:53.244317 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-69d63648-ffc8-4465-b473-da238571377b tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:53.244982 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-69d63648-ffc8-4465-b473-da238571377b tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:53.251290 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-69d63648-ffc8-4465-b473-da238571377b tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:53.251759 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-69d63648-ffc8-4465-b473-da238571377b tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:53.252517 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-69d63648-ffc8-4465-b473-da238571377b tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:53.252951 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-69d63648-ffc8-4465-b473-da238571377b tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:53.399937 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-69d63648-ffc8-4465-b473-da238571377b tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:53.409259 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-69d63648-ffc8-4465-b473-da238571377b tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1759 microversion: 2.1 time: 0.168614 Feb 16 14:31:53.409832 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 482/909] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:53 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1759 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:53.659555 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-fcc40ff9-bcfd-4cbc-8735-97cc70f99389 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:53.660165 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-fcc40ff9-bcfd-4cbc-8735-97cc70f99389 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: cc0fdcf7-b856-43f5-b061-b03d687c327f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:53.667034 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fcc40ff9-bcfd-4cbc-8735-97cc70f99389 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:53.667489 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fcc40ff9-bcfd-4cbc-8735-97cc70f99389 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:53.668277 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fcc40ff9-bcfd-4cbc-8735-97cc70f99389 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:53.668715 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fcc40ff9-bcfd-4cbc-8735-97cc70f99389 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:53.811609 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-fcc40ff9-bcfd-4cbc-8735-97cc70f99389 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:53.817153 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-2e9865ab-62d2-41cf-8ada-2e04ff7f2627 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:53.817791 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-2e9865ab-62d2-41cf-8ada-2e04ff7f2627 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:53.819042 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-fcc40ff9-bcfd-4cbc-8735-97cc70f99389 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f" status: 200 len: 1268 microversion: 2.1 time: 0.163118 Feb 16 14:31:53.819620 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 428/910] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:53 2022] GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f => generated 1268 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:53.823989 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-2e9865ab-62d2-41cf-8ada-2e04ff7f2627 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:53.824435 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-2e9865ab-62d2-41cf-8ada-2e04ff7f2627 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:53.825214 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-2e9865ab-62d2-41cf-8ada-2e04ff7f2627 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:53.825655 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-2e9865ab-62d2-41cf-8ada-2e04ff7f2627 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:53.887471 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6582c952-97d1-4b9b-abf1-00a20211b196 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:53.888088 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-6582c952-97d1-4b9b-abf1-00a20211b196 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f07b0b32-9726-4fef-b3d7-31da2f0ca96f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:53.893850 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6582c952-97d1-4b9b-abf1-00a20211b196 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:53.894314 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6582c952-97d1-4b9b-abf1-00a20211b196 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:53.895132 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6582c952-97d1-4b9b-abf1-00a20211b196 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:53.895576 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6582c952-97d1-4b9b-abf1-00a20211b196 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:53.959114 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-2e9865ab-62d2-41cf-8ada-2e04ff7f2627 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:53.967640 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-2e9865ab-62d2-41cf-8ada-2e04ff7f2627 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:53.969242 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-2e9865ab-62d2-41cf-8ada-2e04ff7f2627 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:53.970415 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-2e9865ab-62d2-41cf-8ada-2e04ff7f2627 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1723 microversion: 2.20 time: 0.157111 Feb 16 14:31:53.971017 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 483/911] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:31:53 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:31:54.034464 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6582c952-97d1-4b9b-abf1-00a20211b196 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:54.042590 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-6582c952-97d1-4b9b-abf1-00a20211b196 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f" status: 200 len: 1518 microversion: 2.1 time: 0.158807 Feb 16 14:31:54.044745 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 429/912] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:53 2022] GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:31:54.436556 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-f6155213-8c8f-4f94-abae-469770905602 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:54.437097 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-f6155213-8c8f-4f94-abae-469770905602 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:54.443398 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f6155213-8c8f-4f94-abae-469770905602 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:54.443845 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f6155213-8c8f-4f94-abae-469770905602 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:54.444640 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f6155213-8c8f-4f94-abae-469770905602 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:54.445063 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f6155213-8c8f-4f94-abae-469770905602 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:54.592138 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-f6155213-8c8f-4f94-abae-469770905602 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:54.599917 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-f6155213-8c8f-4f94-abae-469770905602 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1759 microversion: 2.1 time: 0.167161 Feb 16 14:31:54.600484 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 484/913] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:54 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1759 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:54.835704 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-bc7481b9-0fb0-4c5f-a03e-bd29d06cc554 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:54.836363 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-bc7481b9-0fb0-4c5f-a03e-bd29d06cc554 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: cc0fdcf7-b856-43f5-b061-b03d687c327f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:54.842643 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bc7481b9-0fb0-4c5f-a03e-bd29d06cc554 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:54.843117 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bc7481b9-0fb0-4c5f-a03e-bd29d06cc554 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:54.843893 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bc7481b9-0fb0-4c5f-a03e-bd29d06cc554 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:54.844326 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-bc7481b9-0fb0-4c5f-a03e-bd29d06cc554 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:54.989363 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-36edc8f3-11cc-4808-a89c-9f83654e5806 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:54.990083 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-36edc8f3-11cc-4808-a89c-9f83654e5806 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:54.996601 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-36edc8f3-11cc-4808-a89c-9f83654e5806 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:54.997057 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-36edc8f3-11cc-4808-a89c-9f83654e5806 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:54.997847 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-36edc8f3-11cc-4808-a89c-9f83654e5806 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:54.998290 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-36edc8f3-11cc-4808-a89c-9f83654e5806 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:55.001251 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-bc7481b9-0fb0-4c5f-a03e-bd29d06cc554 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:55.008622 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-bc7481b9-0fb0-4c5f-a03e-bd29d06cc554 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f" status: 200 len: 1268 microversion: 2.1 time: 0.176548 Feb 16 14:31:55.009469 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 430/914] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:54 2022] GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f => generated 1268 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:55.059981 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-de924e7d-7a22-4b02-ac51-e4aab1275367 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:55.060607 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-de924e7d-7a22-4b02-ac51-e4aab1275367 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f07b0b32-9726-4fef-b3d7-31da2f0ca96f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:55.066428 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-de924e7d-7a22-4b02-ac51-e4aab1275367 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:55.066918 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-de924e7d-7a22-4b02-ac51-e4aab1275367 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:55.067718 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-de924e7d-7a22-4b02-ac51-e4aab1275367 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:55.068162 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-de924e7d-7a22-4b02-ac51-e4aab1275367 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:55.133584 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-36edc8f3-11cc-4808-a89c-9f83654e5806 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:55.142117 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-36edc8f3-11cc-4808-a89c-9f83654e5806 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:55.143649 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-36edc8f3-11cc-4808-a89c-9f83654e5806 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:55.144794 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-36edc8f3-11cc-4808-a89c-9f83654e5806 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1723 microversion: 2.20 time: 0.159200 Feb 16 14:31:55.145578 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 485/915] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:31:54 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:31:55.280990 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-de924e7d-7a22-4b02-ac51-e4aab1275367 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:55.288282 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-de924e7d-7a22-4b02-ac51-e4aab1275367 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f" status: 200 len: 1518 microversion: 2.1 time: 0.232551 Feb 16 14:31:55.288853 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 431/916] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:55 2022] GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f => generated 1518 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:31:55.618144 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-97a746fe-6354-4ae8-a7f8-b203e3d8e914 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:55.618883 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-97a746fe-6354-4ae8-a7f8-b203e3d8e914 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:55.625942 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-97a746fe-6354-4ae8-a7f8-b203e3d8e914 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:55.626399 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-97a746fe-6354-4ae8-a7f8-b203e3d8e914 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:55.627471 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-97a746fe-6354-4ae8-a7f8-b203e3d8e914 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:55.627910 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-97a746fe-6354-4ae8-a7f8-b203e3d8e914 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:55.785192 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-97a746fe-6354-4ae8-a7f8-b203e3d8e914 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:55.793434 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-97a746fe-6354-4ae8-a7f8-b203e3d8e914 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1759 microversion: 2.1 time: 0.179569 Feb 16 14:31:55.794020 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 486/917] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:55 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1759 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:55.818699 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-4917fe4d-bb74-46dd-b352-2e1517325378 req-89ccc1ca-acfe-4b36-a807-ce933f260e89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f07b0b32-9726-4fef-b3d7-31da2f0ca96f", "name": "network-vif-deleted", "tag": "e397d52b-5ec8-4dbd-ab87-9d0b217f7995"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:31:55.820447 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:31:55.820447 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: warnings.warn(msg) Feb 16 14:31:55.828196 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-4917fe4d-bb74-46dd-b352-2e1517325378 req-89ccc1ca-acfe-4b36-a807-ce933f260e89 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:55.828633 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-4917fe4d-bb74-46dd-b352-2e1517325378 req-89ccc1ca-acfe-4b36-a807-ce933f260e89 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:55.842047 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-4917fe4d-bb74-46dd-b352-2e1517325378 req-89ccc1ca-acfe-4b36-a807-ce933f260e89 service nova] Creating event network-vif-deleted:e397d52b-5ec8-4dbd-ab87-9d0b217f7995 for instance f07b0b32-9726-4fef-b3d7-31da2f0ca96f on hv-cinder-80473 Feb 16 14:31:55.846704 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-4917fe4d-bb74-46dd-b352-2e1517325378 req-89ccc1ca-acfe-4b36-a807-ce933f260e89 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031615 Feb 16 14:31:55.847313 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 432/918] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:31:56.024734 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-b367e838-6f23-4a4f-8b95-120fca425d8d tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:56.028726 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-b367e838-6f23-4a4f-8b95-120fca425d8d tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: cc0fdcf7-b856-43f5-b061-b03d687c327f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:56.032376 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b367e838-6f23-4a4f-8b95-120fca425d8d tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:56.032897 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b367e838-6f23-4a4f-8b95-120fca425d8d tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:56.033680 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b367e838-6f23-4a4f-8b95-120fca425d8d tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:56.034111 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b367e838-6f23-4a4f-8b95-120fca425d8d tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:56.162979 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-5d6c0a12-e2cc-4797-bd93-3c964f3cebb9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:56.163682 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-5d6c0a12-e2cc-4797-bd93-3c964f3cebb9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:56.169827 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5d6c0a12-e2cc-4797-bd93-3c964f3cebb9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:56.170277 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5d6c0a12-e2cc-4797-bd93-3c964f3cebb9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:56.171101 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5d6c0a12-e2cc-4797-bd93-3c964f3cebb9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:56.171548 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5d6c0a12-e2cc-4797-bd93-3c964f3cebb9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:56.174205 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-b367e838-6f23-4a4f-8b95-120fca425d8d tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:56.182334 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-b367e838-6f23-4a4f-8b95-120fca425d8d tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f" status: 200 len: 1268 microversion: 2.1 time: 0.160713 Feb 16 14:31:56.189092 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 487/919] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:56 2022] GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:56.304996 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-d50ccd90-b7ba-4063-90ef-8ec6dbc3713e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:56.305822 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-d50ccd90-b7ba-4063-90ef-8ec6dbc3713e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f07b0b32-9726-4fef-b3d7-31da2f0ca96f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:56.308504 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-5d6c0a12-e2cc-4797-bd93-3c964f3cebb9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:56.312794 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d50ccd90-b7ba-4063-90ef-8ec6dbc3713e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:56.313348 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d50ccd90-b7ba-4063-90ef-8ec6dbc3713e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:56.314139 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d50ccd90-b7ba-4063-90ef-8ec6dbc3713e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:56.314574 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d50ccd90-b7ba-4063-90ef-8ec6dbc3713e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:56.316317 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-5d6c0a12-e2cc-4797-bd93-3c964f3cebb9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:56.317828 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-5d6c0a12-e2cc-4797-bd93-3c964f3cebb9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:56.319022 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-5d6c0a12-e2cc-4797-bd93-3c964f3cebb9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1723 microversion: 2.20 time: 0.160245 Feb 16 14:31:56.319581 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 433/920] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:31:56 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:31:56.345167 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d50ccd90-b7ba-4063-90ef-8ec6dbc3713e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:56.345597 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d50ccd90-b7ba-4063-90ef-8ec6dbc3713e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:56.346045 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.objects.instance [None req-d50ccd90-b7ba-4063-90ef-8ec6dbc3713e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lazy-loading 'fault' on Instance uuid f07b0b32-9726-4fef-b3d7-31da2f0ca96f {{(pid=117031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:31:56.383875 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-d50ccd90-b7ba-4063-90ef-8ec6dbc3713e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:56.391830 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-d50ccd90-b7ba-4063-90ef-8ec6dbc3713e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f" status: 200 len: 1312 microversion: 2.1 time: 0.090601 Feb 16 14:31:56.392393 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 488/921] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:56 2022] GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f => generated 1312 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:31:56.809856 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-122a81d3-f9df-4e07-8eed-4af6b87dabb5 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:56.810473 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-122a81d3-f9df-4e07-8eed-4af6b87dabb5 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:56.817369 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-122a81d3-f9df-4e07-8eed-4af6b87dabb5 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:56.817823 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-122a81d3-f9df-4e07-8eed-4af6b87dabb5 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:56.818609 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-122a81d3-f9df-4e07-8eed-4af6b87dabb5 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:56.819103 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-122a81d3-f9df-4e07-8eed-4af6b87dabb5 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:56.967253 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-122a81d3-f9df-4e07-8eed-4af6b87dabb5 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:56.975091 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-122a81d3-f9df-4e07-8eed-4af6b87dabb5 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1759 microversion: 2.1 time: 0.168907 Feb 16 14:31:56.975656 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 434/922] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:56 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1759 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:57.199447 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-7cfd4e8a-2bb2-45e2-8703-57c3c61f46db tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:57.200054 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-7cfd4e8a-2bb2-45e2-8703-57c3c61f46db tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: cc0fdcf7-b856-43f5-b061-b03d687c327f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:57.206541 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7cfd4e8a-2bb2-45e2-8703-57c3c61f46db tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:57.207022 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7cfd4e8a-2bb2-45e2-8703-57c3c61f46db tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:57.207798 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7cfd4e8a-2bb2-45e2-8703-57c3c61f46db tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:57.208235 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7cfd4e8a-2bb2-45e2-8703-57c3c61f46db tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:57.337618 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-151c51b2-cb1f-4d97-86ae-f7f8778d1ad4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:57.339357 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-151c51b2-cb1f-4d97-86ae-f7f8778d1ad4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:57.340083 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-7cfd4e8a-2bb2-45e2-8703-57c3c61f46db tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:57.345221 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-151c51b2-cb1f-4d97-86ae-f7f8778d1ad4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:57.345676 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-151c51b2-cb1f-4d97-86ae-f7f8778d1ad4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:57.352145 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-151c51b2-cb1f-4d97-86ae-f7f8778d1ad4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:57.352145 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-151c51b2-cb1f-4d97-86ae-f7f8778d1ad4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:57.352330 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-7cfd4e8a-2bb2-45e2-8703-57c3c61f46db tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f" status: 200 len: 1268 microversion: 2.1 time: 0.152838 Feb 16 14:31:57.352330 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 489/923] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:57 2022] GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:57.408640 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-69820579-dedd-4f9f-88d6-112c3ea27624 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:57.409442 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-69820579-dedd-4f9f-88d6-112c3ea27624 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f07b0b32-9726-4fef-b3d7-31da2f0ca96f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:57.416319 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-69820579-dedd-4f9f-88d6-112c3ea27624 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:57.417011 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-69820579-dedd-4f9f-88d6-112c3ea27624 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:57.417980 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-69820579-dedd-4f9f-88d6-112c3ea27624 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:57.418426 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-69820579-dedd-4f9f-88d6-112c3ea27624 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:57.432514 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.wsgi [None req-69820579-dedd-4f9f-88d6-112c3ea27624 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] HTTP exception thrown: Instance f07b0b32-9726-4fef-b3d7-31da2f0ca96f could not be found. Feb 16 14:31:57.433120 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-69820579-dedd-4f9f-88d6-112c3ea27624 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Returning 404 to user: Instance f07b0b32-9726-4fef-b3d7-31da2f0ca96f could not be found. {{(pid=117031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:31:57.433985 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-69820579-dedd-4f9f-88d6-112c3ea27624 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f" status: 404 len: 111 microversion: 2.1 time: 0.029131 Feb 16 14:31:57.437395 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 490/924] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:57 2022] GET /compute/v2.1/servers/f07b0b32-9726-4fef-b3d7-31da2f0ca96f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 14:31:57.442409 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-e150c5ef-9110-46f0-a6d8-7eb011a901fa tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:57.442937 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-e150c5ef-9110-46f0-a6d8-7eb011a901fa tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: 0185f443-9306-4933-b44f-814c65b3c0b9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:57.449448 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e150c5ef-9110-46f0-a6d8-7eb011a901fa tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:57.449750 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e150c5ef-9110-46f0-a6d8-7eb011a901fa tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:57.450540 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e150c5ef-9110-46f0-a6d8-7eb011a901fa tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:57.451000 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e150c5ef-9110-46f0-a6d8-7eb011a901fa tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:57.480229 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-e150c5ef-9110-46f0-a6d8-7eb011a901fa tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: 0185f443-9306-4933-b44f-814c65b3c0b9] Going to try to terminate instance {{(pid=117031) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 16 14:31:57.496479 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-151c51b2-cb1f-4d97-86ae-f7f8778d1ad4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:57.504198 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-151c51b2-cb1f-4d97-86ae-f7f8778d1ad4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:57.505724 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-151c51b2-cb1f-4d97-86ae-f7f8778d1ad4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:57.507321 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-151c51b2-cb1f-4d97-86ae-f7f8778d1ad4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1744 microversion: 2.20 time: 0.173334 Feb 16 14:31:57.508226 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 435/925] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:31:57 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1744 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:31:57.784214 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-e150c5ef-9110-46f0-a6d8-7eb011a901fa tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "DELETE /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9" status: 204 len: 0 microversion: 2.1 time: 0.344921 Feb 16 14:31:57.784806 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 491/926] 10.222.0.110 () {58 vars in 1243 bytes} [Wed Feb 16 14:31:57 2022] DELETE /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 16 14:31:57.793317 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-3390bead-03e8-4fed-b1e7-8635dc86dd1e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:57.793965 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-3390bead-03e8-4fed-b1e7-8635dc86dd1e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: 0185f443-9306-4933-b44f-814c65b3c0b9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:57.799926 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3390bead-03e8-4fed-b1e7-8635dc86dd1e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:57.800382 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3390bead-03e8-4fed-b1e7-8635dc86dd1e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:57.801166 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3390bead-03e8-4fed-b1e7-8635dc86dd1e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:57.801606 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3390bead-03e8-4fed-b1e7-8635dc86dd1e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:57.938805 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3390bead-03e8-4fed-b1e7-8635dc86dd1e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:57.946106 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-3390bead-03e8-4fed-b1e7-8635dc86dd1e tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9" status: 200 len: 1518 microversion: 2.1 time: 0.157202 Feb 16 14:31:57.946699 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 436/927] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:57 2022] GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:57.993180 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-58252f43-5324-4ebc-b7b2-4b0154c52607 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:57.993871 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-58252f43-5324-4ebc-b7b2-4b0154c52607 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:57.999699 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-58252f43-5324-4ebc-b7b2-4b0154c52607 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:58.000140 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-58252f43-5324-4ebc-b7b2-4b0154c52607 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:58.000909 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-58252f43-5324-4ebc-b7b2-4b0154c52607 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:58.001337 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-58252f43-5324-4ebc-b7b2-4b0154c52607 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:58.153055 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-58252f43-5324-4ebc-b7b2-4b0154c52607 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:58.160970 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-58252f43-5324-4ebc-b7b2-4b0154c52607 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1759 microversion: 2.1 time: 0.171769 Feb 16 14:31:58.161537 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 492/928] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:57 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1759 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:58.364571 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-1060e8cd-7d7c-4a8d-8aa1-b3400704b8b3 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:58.365185 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-1060e8cd-7d7c-4a8d-8aa1-b3400704b8b3 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: cc0fdcf7-b856-43f5-b061-b03d687c327f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:58.371874 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1060e8cd-7d7c-4a8d-8aa1-b3400704b8b3 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:58.372335 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1060e8cd-7d7c-4a8d-8aa1-b3400704b8b3 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:58.373122 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1060e8cd-7d7c-4a8d-8aa1-b3400704b8b3 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:58.373569 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1060e8cd-7d7c-4a8d-8aa1-b3400704b8b3 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:58.507864 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-1060e8cd-7d7c-4a8d-8aa1-b3400704b8b3 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:58.515710 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-1060e8cd-7d7c-4a8d-8aa1-b3400704b8b3 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f" status: 200 len: 1268 microversion: 2.1 time: 0.154873 Feb 16 14:31:58.516288 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 437/929] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:58 2022] GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:58.524878 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-73e4a021-ec1d-46eb-8229-9acb937d1190 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:58.525577 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-73e4a021-ec1d-46eb-8229-9acb937d1190 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:58.531841 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-73e4a021-ec1d-46eb-8229-9acb937d1190 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:58.532288 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-73e4a021-ec1d-46eb-8229-9acb937d1190 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:58.533063 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-73e4a021-ec1d-46eb-8229-9acb937d1190 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:58.533492 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-73e4a021-ec1d-46eb-8229-9acb937d1190 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:58.668094 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-73e4a021-ec1d-46eb-8229-9acb937d1190 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:58.675878 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-73e4a021-ec1d-46eb-8229-9acb937d1190 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:58.677382 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-73e4a021-ec1d-46eb-8229-9acb937d1190 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:58.678570 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-73e4a021-ec1d-46eb-8229-9acb937d1190 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1744 microversion: 2.20 time: 0.157294 Feb 16 14:31:58.679157 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 493/930] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:31:58 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:31:58.964614 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-149167e6-e19b-4f7b-b389-33d461f2fd8f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:58.965227 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-149167e6-e19b-4f7b-b389-33d461f2fd8f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: 0185f443-9306-4933-b44f-814c65b3c0b9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:58.971582 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-149167e6-e19b-4f7b-b389-33d461f2fd8f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:58.972033 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-149167e6-e19b-4f7b-b389-33d461f2fd8f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:58.972815 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-149167e6-e19b-4f7b-b389-33d461f2fd8f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:58.973252 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-149167e6-e19b-4f7b-b389-33d461f2fd8f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:59.107007 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-149167e6-e19b-4f7b-b389-33d461f2fd8f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:59.114260 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-149167e6-e19b-4f7b-b389-33d461f2fd8f tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9" status: 200 len: 1518 microversion: 2.1 time: 0.154151 Feb 16 14:31:59.114860 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 438/931] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:58 2022] GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:59.178301 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-dae56a98-8abe-432a-90b9-5b5b8eba4239 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:59.178937 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-dae56a98-8abe-432a-90b9-5b5b8eba4239 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:59.185452 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-dae56a98-8abe-432a-90b9-5b5b8eba4239 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:59.185903 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-dae56a98-8abe-432a-90b9-5b5b8eba4239 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:59.186705 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-dae56a98-8abe-432a-90b9-5b5b8eba4239 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:59.187140 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-dae56a98-8abe-432a-90b9-5b5b8eba4239 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:59.331732 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-dae56a98-8abe-432a-90b9-5b5b8eba4239 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:59.339624 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-dae56a98-8abe-432a-90b9-5b5b8eba4239 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1762 microversion: 2.1 time: 0.164995 Feb 16 14:31:59.340181 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 494/932] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:59 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1762 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:31:59.532322 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-d338d8e0-346a-4b3c-8d3c-b1d71b92ae7e tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:59.532959 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-d338d8e0-346a-4b3c-8d3c-b1d71b92ae7e tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: cc0fdcf7-b856-43f5-b061-b03d687c327f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:59.538795 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d338d8e0-346a-4b3c-8d3c-b1d71b92ae7e tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:59.539246 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d338d8e0-346a-4b3c-8d3c-b1d71b92ae7e tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:59.540024 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d338d8e0-346a-4b3c-8d3c-b1d71b92ae7e tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:59.540453 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d338d8e0-346a-4b3c-8d3c-b1d71b92ae7e tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:59.668895 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-f967b5dd-76c3-48e7-9cbf-f47da324ae82 req-a1670d58-eb00-4478-91b3-4ed935b5dc6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc0fdcf7-b856-43f5-b061-b03d687c327f", "name": "network-vif-plugged", "status": "completed", "tag": "14aabd43-ae85-477e-98bf-28c418d8f834"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:31:59.670730 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:31:59.670730 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:31:59.679930 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-f967b5dd-76c3-48e7-9cbf-f47da324ae82 req-a1670d58-eb00-4478-91b3-4ed935b5dc6d service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:59.684589 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-f967b5dd-76c3-48e7-9cbf-f47da324ae82 req-a1670d58-eb00-4478-91b3-4ed935b5dc6d service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:59.684899 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d338d8e0-346a-4b3c-8d3c-b1d71b92ae7e tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:59.690051 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-d338d8e0-346a-4b3c-8d3c-b1d71b92ae7e tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f" status: 200 len: 1268 microversion: 2.1 time: 0.161574 Feb 16 14:31:59.691150 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 439/933] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:31:59 2022] GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:31:59.696178 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c4e9bfb7-a2b2-4bc8-90bc-eb8e97f01e95 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:31:59.696801 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c4e9bfb7-a2b2-4bc8-90bc-eb8e97f01e95 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:31:59.702107 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-f967b5dd-76c3-48e7-9cbf-f47da324ae82 req-a1670d58-eb00-4478-91b3-4ed935b5dc6d service nova] Creating event network-vif-plugged:14aabd43-ae85-477e-98bf-28c418d8f834 for instance cc0fdcf7-b856-43f5-b061-b03d687c327f on hv-cinder-80473 Feb 16 14:31:59.703188 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c4e9bfb7-a2b2-4bc8-90bc-eb8e97f01e95 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:59.703648 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c4e9bfb7-a2b2-4bc8-90bc-eb8e97f01e95 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:59.704788 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c4e9bfb7-a2b2-4bc8-90bc-eb8e97f01e95 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:31:59.705112 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c4e9bfb7-a2b2-4bc8-90bc-eb8e97f01e95 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:31:59.707263 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-f967b5dd-76c3-48e7-9cbf-f47da324ae82 req-a1670d58-eb00-4478-91b3-4ed935b5dc6d service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043354 Feb 16 14:31:59.707930 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 495/934] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:31:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:31:59.847445 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c4e9bfb7-a2b2-4bc8-90bc-eb8e97f01e95 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:59.855958 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c4e9bfb7-a2b2-4bc8-90bc-eb8e97f01e95 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:59.857459 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c4e9bfb7-a2b2-4bc8-90bc-eb8e97f01e95 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:31:59.858775 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c4e9bfb7-a2b2-4bc8-90bc-eb8e97f01e95 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1744 microversion: 2.20 time: 0.166118 Feb 16 14:31:59.859351 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 440/935] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:31:59 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1744 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:32:00.144034 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-0049257b-8d97-4368-b74e-a89caaf7833d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:00.146036 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-0049257b-8d97-4368-b74e-a89caaf7833d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: 0185f443-9306-4933-b44f-814c65b3c0b9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:00.157207 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0049257b-8d97-4368-b74e-a89caaf7833d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:00.157666 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0049257b-8d97-4368-b74e-a89caaf7833d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:00.158472 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0049257b-8d97-4368-b74e-a89caaf7833d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:00.158937 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0049257b-8d97-4368-b74e-a89caaf7833d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:00.304394 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-0049257b-8d97-4368-b74e-a89caaf7833d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:00.312793 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-0049257b-8d97-4368-b74e-a89caaf7833d tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9" status: 200 len: 1518 microversion: 2.1 time: 0.183213 Feb 16 14:32:00.313574 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 496/936] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:32:00 2022] GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9 => generated 1518 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:32:00.707289 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-00ecaf7c-69a2-4e06-ba63-99cf939c976a tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:00.708511 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-00ecaf7c-69a2-4e06-ba63-99cf939c976a tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: cc0fdcf7-b856-43f5-b061-b03d687c327f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:00.716150 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-00ecaf7c-69a2-4e06-ba63-99cf939c976a tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:00.716842 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-00ecaf7c-69a2-4e06-ba63-99cf939c976a tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:00.717844 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-00ecaf7c-69a2-4e06-ba63-99cf939c976a tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:00.718434 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-00ecaf7c-69a2-4e06-ba63-99cf939c976a tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:00.769444 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-88c74c51-e910-4091-8021-013f7263e1ad req-3a1a33da-75b5-46ca-9d89-b515902e968c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0185f443-9306-4933-b44f-814c65b3c0b9", "name": "network-vif-deleted", "tag": "f45e1896-cbac-4079-bf31-95878784e9ba"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:32:00.771715 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:32:00.771715 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:32:00.780609 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-88c74c51-e910-4091-8021-013f7263e1ad req-3a1a33da-75b5-46ca-9d89-b515902e968c service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:00.781581 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-88c74c51-e910-4091-8021-013f7263e1ad req-3a1a33da-75b5-46ca-9d89-b515902e968c service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:00.809358 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-88c74c51-e910-4091-8021-013f7263e1ad req-3a1a33da-75b5-46ca-9d89-b515902e968c service nova] Creating event network-vif-deleted:f45e1896-cbac-4079-bf31-95878784e9ba for instance 0185f443-9306-4933-b44f-814c65b3c0b9 on hv-cinder-80473 Feb 16 14:32:00.816753 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-88c74c51-e910-4091-8021-013f7263e1ad req-3a1a33da-75b5-46ca-9d89-b515902e968c service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051350 Feb 16 14:32:00.821796 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 497/937] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 14:32:00.880279 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-d8485e03-fd29-4b83-8dd2-b7973d3aad28 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:00.881033 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-d8485e03-fd29-4b83-8dd2-b7973d3aad28 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:00.893445 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d8485e03-fd29-4b83-8dd2-b7973d3aad28 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:00.893903 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d8485e03-fd29-4b83-8dd2-b7973d3aad28 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:00.894751 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d8485e03-fd29-4b83-8dd2-b7973d3aad28 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:00.895163 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d8485e03-fd29-4b83-8dd2-b7973d3aad28 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:00.906489 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-00ecaf7c-69a2-4e06-ba63-99cf939c976a tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:00.915152 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-00ecaf7c-69a2-4e06-ba63-99cf939c976a tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f" status: 200 len: 1268 microversion: 2.1 time: 0.211684 Feb 16 14:32:00.918820 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 441/938] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:32:00 2022] GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f => generated 1268 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:32:01.066859 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-d8485e03-fd29-4b83-8dd2-b7973d3aad28 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:01.076458 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-d8485e03-fd29-4b83-8dd2-b7973d3aad28 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:01.078594 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-d8485e03-fd29-4b83-8dd2-b7973d3aad28 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:01.079869 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-d8485e03-fd29-4b83-8dd2-b7973d3aad28 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1739 microversion: 2.20 time: 0.205564 Feb 16 14:32:01.091380 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 498/939] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:32:00 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1739 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:32:01.330642 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-4d71f77b-0022-4ca1-b6f0-33803c835713 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:01.331181 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-4d71f77b-0022-4ca1-b6f0-33803c835713 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: 0185f443-9306-4933-b44f-814c65b3c0b9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:01.337237 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4d71f77b-0022-4ca1-b6f0-33803c835713 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:01.338209 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4d71f77b-0022-4ca1-b6f0-33803c835713 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:01.339025 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4d71f77b-0022-4ca1-b6f0-33803c835713 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:01.339625 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4d71f77b-0022-4ca1-b6f0-33803c835713 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:01.372687 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4d71f77b-0022-4ca1-b6f0-33803c835713 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:01.373137 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4d71f77b-0022-4ca1-b6f0-33803c835713 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:01.373589 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-4d71f77b-0022-4ca1-b6f0-33803c835713 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lazy-loading 'fault' on Instance uuid 0185f443-9306-4933-b44f-814c65b3c0b9 {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:32:01.414366 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-4d71f77b-0022-4ca1-b6f0-33803c835713 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:01.422234 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-4d71f77b-0022-4ca1-b6f0-33803c835713 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9" status: 200 len: 1312 microversion: 2.1 time: 0.095660 Feb 16 14:32:01.423615 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 442/940] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:32:01 2022] GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9 => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:32:01.804375 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-93668d25-1594-4601-87a3-b15f3a624a7e req-22fb98eb-de3d-457e-bf5c-4c90bac70905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "542bf2d6-2c49-48e1-a903-3a14bcfb1b0d", "name": "network-vif-plugged", "status": "completed", "tag": "c35750d8-fe77-4744-8fd1-c9914d7c2435"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:32:01.805902 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:32:01.805902 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:32:01.823535 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-93668d25-1594-4601-87a3-b15f3a624a7e req-22fb98eb-de3d-457e-bf5c-4c90bac70905 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:01.824308 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-93668d25-1594-4601-87a3-b15f3a624a7e req-22fb98eb-de3d-457e-bf5c-4c90bac70905 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:01.852592 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-93668d25-1594-4601-87a3-b15f3a624a7e req-22fb98eb-de3d-457e-bf5c-4c90bac70905 service nova] Creating event network-vif-plugged:c35750d8-fe77-4744-8fd1-c9914d7c2435 for instance 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d on hv-cinder-80473 Feb 16 14:32:01.858527 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-93668d25-1594-4601-87a3-b15f3a624a7e req-22fb98eb-de3d-457e-bf5c-4c90bac70905 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057773 Feb 16 14:32:01.874360 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 499/941] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:32:01.934524 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6edc49e3-6662-4d5a-8fdc-3759825a5515 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:01.935232 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-6edc49e3-6662-4d5a-8fdc-3759825a5515 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: cc0fdcf7-b856-43f5-b061-b03d687c327f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:01.944183 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6edc49e3-6662-4d5a-8fdc-3759825a5515 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:01.944889 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6edc49e3-6662-4d5a-8fdc-3759825a5515 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:01.945877 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6edc49e3-6662-4d5a-8fdc-3759825a5515 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:01.946322 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6edc49e3-6662-4d5a-8fdc-3759825a5515 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:02.099758 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-2f1e0ede-4aeb-4442-add9-767734179212 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:02.101937 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-2f1e0ede-4aeb-4442-add9-767734179212 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:02.114062 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6edc49e3-6662-4d5a-8fdc-3759825a5515 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:02.115363 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-2f1e0ede-4aeb-4442-add9-767734179212 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:02.116630 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-2f1e0ede-4aeb-4442-add9-767734179212 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:02.117650 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-2f1e0ede-4aeb-4442-add9-767734179212 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:02.118387 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-2f1e0ede-4aeb-4442-add9-767734179212 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:02.124162 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-6edc49e3-6662-4d5a-8fdc-3759825a5515 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f" status: 200 len: 1268 microversion: 2.1 time: 0.194490 Feb 16 14:32:02.125900 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 443/942] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:32:01 2022] GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f => generated 1268 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:32:02.276937 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-2f1e0ede-4aeb-4442-add9-767734179212 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:02.288541 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-2f1e0ede-4aeb-4442-add9-767734179212 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:02.290045 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-2f1e0ede-4aeb-4442-add9-767734179212 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:02.302293 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-2f1e0ede-4aeb-4442-add9-767734179212 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1739 microversion: 2.20 time: 0.207362 Feb 16 14:32:02.303357 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 500/943] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:32:02 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1739 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:32:02.441702 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b3466e96-427b-4c85-863e-bc2af0c15bcc tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:02.442417 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b3466e96-427b-4c85-863e-bc2af0c15bcc tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: 0185f443-9306-4933-b44f-814c65b3c0b9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:02.449588 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b3466e96-427b-4c85-863e-bc2af0c15bcc tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:02.450015 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b3466e96-427b-4c85-863e-bc2af0c15bcc tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:02.450954 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b3466e96-427b-4c85-863e-bc2af0c15bcc tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:02.451468 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b3466e96-427b-4c85-863e-bc2af0c15bcc tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:02.470250 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-b3466e96-427b-4c85-863e-bc2af0c15bcc tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] HTTP exception thrown: Instance 0185f443-9306-4933-b44f-814c65b3c0b9 could not be found. Feb 16 14:32:02.470953 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b3466e96-427b-4c85-863e-bc2af0c15bcc tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Returning 404 to user: Instance 0185f443-9306-4933-b44f-814c65b3c0b9 could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:32:02.472014 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b3466e96-427b-4c85-863e-bc2af0c15bcc tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9" status: 404 len: 111 microversion: 2.1 time: 0.034351 Feb 16 14:32:02.475597 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 444/944] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:32:02 2022] GET /compute/v2.1/servers/0185f443-9306-4933-b44f-814c65b3c0b9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 14:32:03.142394 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-1656a422-fd54-4b3b-91d8-fe444cd37d58 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:03.143037 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-1656a422-fd54-4b3b-91d8-fe444cd37d58 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: cc0fdcf7-b856-43f5-b061-b03d687c327f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:03.150108 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1656a422-fd54-4b3b-91d8-fe444cd37d58 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:03.150969 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1656a422-fd54-4b3b-91d8-fe444cd37d58 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:03.151905 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1656a422-fd54-4b3b-91d8-fe444cd37d58 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:03.152498 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1656a422-fd54-4b3b-91d8-fe444cd37d58 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:03.309223 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-1656a422-fd54-4b3b-91d8-fe444cd37d58 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:03.317845 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-1656a422-fd54-4b3b-91d8-fe444cd37d58 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f" status: 200 len: 1455 microversion: 2.1 time: 0.179220 Feb 16 14:32:03.318823 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 501/945] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:32:03 2022] GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f => generated 1455 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:32:03.321685 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c7e9b412-7bd1-479e-bdea-7c237b1f608d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:03.321685 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c7e9b412-7bd1-479e-bdea-7c237b1f608d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:03.335564 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-48c98668-e366-45c4-abf6-0eebcb07db28 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:03.336096 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c7e9b412-7bd1-479e-bdea-7c237b1f608d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:03.336569 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c7e9b412-7bd1-479e-bdea-7c237b1f608d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:03.336723 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-48c98668-e366-45c4-abf6-0eebcb07db28 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: cc0fdcf7-b856-43f5-b061-b03d687c327f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:03.338556 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c7e9b412-7bd1-479e-bdea-7c237b1f608d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:03.339574 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c7e9b412-7bd1-479e-bdea-7c237b1f608d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:03.344614 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-48c98668-e366-45c4-abf6-0eebcb07db28 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:03.346882 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-48c98668-e366-45c4-abf6-0eebcb07db28 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:03.348154 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-48c98668-e366-45c4-abf6-0eebcb07db28 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:03.348778 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-48c98668-e366-45c4-abf6-0eebcb07db28 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:03.527718 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-48c98668-e366-45c4-abf6-0eebcb07db28 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:03.528450 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c7e9b412-7bd1-479e-bdea-7c237b1f608d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:03.535944 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-48c98668-e366-45c4-abf6-0eebcb07db28 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f" status: 200 len: 1455 microversion: 2.1 time: 0.204100 Feb 16 14:32:03.536270 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c7e9b412-7bd1-479e-bdea-7c237b1f608d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:03.536566 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 502/946] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:32:03 2022] GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f => generated 1455 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:32:03.537806 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c7e9b412-7bd1-479e-bdea-7c237b1f608d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:03.539009 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c7e9b412-7bd1-479e-bdea-7c237b1f608d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1739 microversion: 2.20 time: 0.222840 Feb 16 14:32:03.539559 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 445/947] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:32:03 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1739 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:32:03.783926 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-a8d2c79d-832d-44ed-9469-89cc5a944090 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:03.784430 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-a8d2c79d-832d-44ed-9469-89cc5a944090 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f8777fc7-22f6-4dcf-885c-c08aa877b001] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:03.803664 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a8d2c79d-832d-44ed-9469-89cc5a944090 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:03.804113 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a8d2c79d-832d-44ed-9469-89cc5a944090 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:03.804887 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a8d2c79d-832d-44ed-9469-89cc5a944090 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:03.805352 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a8d2c79d-832d-44ed-9469-89cc5a944090 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:03.829202 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-a8d2c79d-832d-44ed-9469-89cc5a944090 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f8777fc7-22f6-4dcf-885c-c08aa877b001] Going to try to terminate instance {{(pid=117031) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 16 14:32:04.218339 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-a8d2c79d-832d-44ed-9469-89cc5a944090 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "DELETE /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001" status: 204 len: 0 microversion: 2.1 time: 0.437656 Feb 16 14:32:04.222355 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 503/948] 10.222.0.110 () {58 vars in 1243 bytes} [Wed Feb 16 14:32:03 2022] DELETE /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 16 14:32:04.227254 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e8603d5c-fb0a-4d11-8aa2-a19c64da0935 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:04.228179 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-e8603d5c-fb0a-4d11-8aa2-a19c64da0935 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f8777fc7-22f6-4dcf-885c-c08aa877b001] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:04.235130 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e8603d5c-fb0a-4d11-8aa2-a19c64da0935 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:04.235865 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e8603d5c-fb0a-4d11-8aa2-a19c64da0935 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:04.236911 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e8603d5c-fb0a-4d11-8aa2-a19c64da0935 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:04.237572 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e8603d5c-fb0a-4d11-8aa2-a19c64da0935 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:04.414350 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-e8603d5c-fb0a-4d11-8aa2-a19c64da0935 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:04.424983 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-e8603d5c-fb0a-4d11-8aa2-a19c64da0935 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001" status: 200 len: 1518 microversion: 2.1 time: 0.201308 Feb 16 14:32:04.437016 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 446/949] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:32:04 2022] GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001 => generated 1518 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:32:04.562148 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-f6b874fa-3c98-4a32-898b-2608d62756ea tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:04.563147 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-f6b874fa-3c98-4a32-898b-2608d62756ea tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:04.570320 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f6b874fa-3c98-4a32-898b-2608d62756ea tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:04.571066 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f6b874fa-3c98-4a32-898b-2608d62756ea tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:04.572021 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f6b874fa-3c98-4a32-898b-2608d62756ea tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:04.572456 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f6b874fa-3c98-4a32-898b-2608d62756ea tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:04.782211 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-f6b874fa-3c98-4a32-898b-2608d62756ea tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:04.792269 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-f6b874fa-3c98-4a32-898b-2608d62756ea tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:04.806125 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-f6b874fa-3c98-4a32-898b-2608d62756ea tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:04.806125 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-f6b874fa-3c98-4a32-898b-2608d62756ea tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1739 microversion: 2.20 time: 0.237433 Feb 16 14:32:04.806125 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 504/950] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:32:04 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1739 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:32:05.444696 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-42e0a240-5f65-45de-96fd-6808864bcd2b tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:05.445945 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-42e0a240-5f65-45de-96fd-6808864bcd2b tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f8777fc7-22f6-4dcf-885c-c08aa877b001] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:05.454278 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-42e0a240-5f65-45de-96fd-6808864bcd2b tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:05.455085 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-42e0a240-5f65-45de-96fd-6808864bcd2b tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:05.455873 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-42e0a240-5f65-45de-96fd-6808864bcd2b tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:05.456477 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-42e0a240-5f65-45de-96fd-6808864bcd2b tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:05.640382 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-42e0a240-5f65-45de-96fd-6808864bcd2b tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:05.650953 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-42e0a240-5f65-45de-96fd-6808864bcd2b tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001" status: 200 len: 1518 microversion: 2.1 time: 0.209672 Feb 16 14:32:05.651546 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 447/951] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:32:05 2022] GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001 => generated 1518 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:32:05.814073 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-cd17813d-a325-4417-b67f-d092a1a0866a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:05.814776 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-cd17813d-a325-4417-b67f-d092a1a0866a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:05.826039 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-cd17813d-a325-4417-b67f-d092a1a0866a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:05.826531 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-cd17813d-a325-4417-b67f-d092a1a0866a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:05.827687 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-cd17813d-a325-4417-b67f-d092a1a0866a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:05.828185 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-cd17813d-a325-4417-b67f-d092a1a0866a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:06.101243 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-cd17813d-a325-4417-b67f-d092a1a0866a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:06.111273 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-cd17813d-a325-4417-b67f-d092a1a0866a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:06.112952 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-cd17813d-a325-4417-b67f-d092a1a0866a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:06.114266 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-cd17813d-a325-4417-b67f-d092a1a0866a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1739 microversion: 2.20 time: 0.304366 Feb 16 14:32:06.123305 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 505/952] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:32:05 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1739 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:32:06.670028 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-cbdceb02-77f2-4165-bc50-29fa61e34e41 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:06.670751 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-cbdceb02-77f2-4165-bc50-29fa61e34e41 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f8777fc7-22f6-4dcf-885c-c08aa877b001] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:06.677787 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-cbdceb02-77f2-4165-bc50-29fa61e34e41 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:06.678242 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-cbdceb02-77f2-4165-bc50-29fa61e34e41 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:06.679504 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-cbdceb02-77f2-4165-bc50-29fa61e34e41 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:06.679951 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-cbdceb02-77f2-4165-bc50-29fa61e34e41 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:06.708606 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-0fee4c68-4709-4e4e-abdb-2245e6538a10 req-45b7ea57-b96e-4f84-a7f0-83380fa9df29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc0fdcf7-b856-43f5-b061-b03d687c327f", "tag": "14aabd43-ae85-477e-98bf-28c418d8f834"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:32:06.712156 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:32:06.712156 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: warnings.warn(msg) Feb 16 14:32:06.725465 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-0fee4c68-4709-4e4e-abdb-2245e6538a10 req-45b7ea57-b96e-4f84-a7f0-83380fa9df29 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:06.726220 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-0fee4c68-4709-4e4e-abdb-2245e6538a10 req-45b7ea57-b96e-4f84-a7f0-83380fa9df29 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:06.765678 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-0fee4c68-4709-4e4e-abdb-2245e6538a10 req-45b7ea57-b96e-4f84-a7f0-83380fa9df29 service nova] Creating event network-changed:14aabd43-ae85-477e-98bf-28c418d8f834 for instance cc0fdcf7-b856-43f5-b061-b03d687c327f on hv-cinder-80473 Feb 16 14:32:06.784122 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-0fee4c68-4709-4e4e-abdb-2245e6538a10 req-45b7ea57-b96e-4f84-a7f0-83380fa9df29 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.218790 Feb 16 14:32:06.785019 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 448/953] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:32:06.894040 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-cbdceb02-77f2-4165-bc50-29fa61e34e41 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:06.902480 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-cbdceb02-77f2-4165-bc50-29fa61e34e41 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001" status: 200 len: 1518 microversion: 2.1 time: 0.238295 Feb 16 14:32:06.903390 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 506/954] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:32:06 2022] GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001 => generated 1518 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:32:07.139943 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-57b6888a-0b41-41f6-bb4f-a65e31c895e0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:07.142037 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-57b6888a-0b41-41f6-bb4f-a65e31c895e0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:07.155998 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-57b6888a-0b41-41f6-bb4f-a65e31c895e0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:07.157591 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-57b6888a-0b41-41f6-bb4f-a65e31c895e0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:07.159406 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-57b6888a-0b41-41f6-bb4f-a65e31c895e0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:07.160483 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-57b6888a-0b41-41f6-bb4f-a65e31c895e0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:07.544247 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-c77241d0-f73d-4ab6-abf2-132d5deaaf10 req-a26309c7-f097-4b57-bd20-b2dad9f31fb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8777fc7-22f6-4dcf-885c-c08aa877b001", "name": "network-vif-deleted", "tag": "68d05aef-cbdf-4b91-a018-b6666d02255e"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:32:07.555226 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:32:07.555226 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:32:07.574871 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-c77241d0-f73d-4ab6-abf2-132d5deaaf10 req-a26309c7-f097-4b57-bd20-b2dad9f31fb9 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:07.576392 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-c77241d0-f73d-4ab6-abf2-132d5deaaf10 req-a26309c7-f097-4b57-bd20-b2dad9f31fb9 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:07.594043 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-57b6888a-0b41-41f6-bb4f-a65e31c895e0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:07.597415 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-c77241d0-f73d-4ab6-abf2-132d5deaaf10 req-a26309c7-f097-4b57-bd20-b2dad9f31fb9 service nova] Creating event network-vif-deleted:68d05aef-cbdf-4b91-a018-b6666d02255e for instance f8777fc7-22f6-4dcf-885c-c08aa877b001 on hv-cinder-80473 Feb 16 14:32:07.608165 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-c77241d0-f73d-4ab6-abf2-132d5deaaf10 req-a26309c7-f097-4b57-bd20-b2dad9f31fb9 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072665 Feb 16 14:32:07.610737 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-57b6888a-0b41-41f6-bb4f-a65e31c895e0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:07.610888 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 507/955] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:32:07.611009 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-57b6888a-0b41-41f6-bb4f-a65e31c895e0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:07.615429 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-57b6888a-0b41-41f6-bb4f-a65e31c895e0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1739 microversion: 2.20 time: 0.479596 Feb 16 14:32:07.616037 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 449/956] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:32:07 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1739 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:32:07.925077 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-6b72280b-8f9c-4454-85c5-c83ebe8c6804 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:07.925616 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-6b72280b-8f9c-4454-85c5-c83ebe8c6804 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f8777fc7-22f6-4dcf-885c-c08aa877b001] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:07.949830 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-6b72280b-8f9c-4454-85c5-c83ebe8c6804 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:07.956755 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-6b72280b-8f9c-4454-85c5-c83ebe8c6804 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:07.956755 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-6b72280b-8f9c-4454-85c5-c83ebe8c6804 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:07.956755 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-6b72280b-8f9c-4454-85c5-c83ebe8c6804 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:07.999679 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-6b72280b-8f9c-4454-85c5-c83ebe8c6804 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:08.000512 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-6b72280b-8f9c-4454-85c5-c83ebe8c6804 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:08.001125 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.objects.instance [None req-6b72280b-8f9c-4454-85c5-c83ebe8c6804 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lazy-loading 'fault' on Instance uuid f8777fc7-22f6-4dcf-885c-c08aa877b001 {{(pid=117031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:32:08.048395 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-6b72280b-8f9c-4454-85c5-c83ebe8c6804 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd0569c12f1740b9a4fab4e6a15f25ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f334385dc44348ac9942c6606482330e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:08.056058 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-6b72280b-8f9c-4454-85c5-c83ebe8c6804 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001" status: 200 len: 1312 microversion: 2.1 time: 0.140464 Feb 16 14:32:08.057623 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 508/957] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:32:07 2022] GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001 => generated 1312 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:32:08.634397 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-46572277-8f0c-4dd5-a5e3-6b635a879e4e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:08.635863 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-46572277-8f0c-4dd5-a5e3-6b635a879e4e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:08.645557 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-46572277-8f0c-4dd5-a5e3-6b635a879e4e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:08.647930 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-46572277-8f0c-4dd5-a5e3-6b635a879e4e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:08.650947 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-46572277-8f0c-4dd5-a5e3-6b635a879e4e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:08.651507 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-46572277-8f0c-4dd5-a5e3-6b635a879e4e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:08.815708 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-46572277-8f0c-4dd5-a5e3-6b635a879e4e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:08.825988 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-46572277-8f0c-4dd5-a5e3-6b635a879e4e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:08.840089 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-46572277-8f0c-4dd5-a5e3-6b635a879e4e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:08.840089 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-46572277-8f0c-4dd5-a5e3-6b635a879e4e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1739 microversion: 2.20 time: 0.198457 Feb 16 14:32:08.840089 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 450/958] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:32:08 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:32:09.074345 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-c4fb4522-d068-435b-be66-a11a78d15557 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:09.074952 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-c4fb4522-d068-435b-be66-a11a78d15557 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] [instance: f8777fc7-22f6-4dcf-885c-c08aa877b001] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:09.085344 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c4fb4522-d068-435b-be66-a11a78d15557 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:09.085801 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c4fb4522-d068-435b-be66-a11a78d15557 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:09.086598 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c4fb4522-d068-435b-be66-a11a78d15557 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:09.087066 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c4fb4522-d068-435b-be66-a11a78d15557 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:09.103075 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.wsgi [None req-c4fb4522-d068-435b-be66-a11a78d15557 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] HTTP exception thrown: Instance f8777fc7-22f6-4dcf-885c-c08aa877b001 could not be found. Feb 16 14:32:09.103379 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-c4fb4522-d068-435b-be66-a11a78d15557 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] Returning 404 to user: Instance f8777fc7-22f6-4dcf-885c-c08aa877b001 could not be found. {{(pid=117031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:32:09.104922 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-c4fb4522-d068-435b-be66-a11a78d15557 tempest-AttachVolumeNegativeTest-2119278253 tempest-AttachVolumeNegativeTest-2119278253-project] 10.222.0.110 "GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001" status: 404 len: 111 microversion: 2.1 time: 0.035849 Feb 16 14:32:09.105853 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 509/959] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:32:09 2022] GET /compute/v2.1/servers/f8777fc7-22f6-4dcf-885c-c08aa877b001 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 14:32:09.847729 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-85d9d0ce-e92f-4ae2-87a5-77f37f4d7c9d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:09.848349 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-85d9d0ce-e92f-4ae2-87a5-77f37f4d7c9d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:09.855568 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-85d9d0ce-e92f-4ae2-87a5-77f37f4d7c9d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:09.856360 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-85d9d0ce-e92f-4ae2-87a5-77f37f4d7c9d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:09.857689 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-85d9d0ce-e92f-4ae2-87a5-77f37f4d7c9d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:09.858862 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-85d9d0ce-e92f-4ae2-87a5-77f37f4d7c9d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:10.037315 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-85d9d0ce-e92f-4ae2-87a5-77f37f4d7c9d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:10.051273 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-85d9d0ce-e92f-4ae2-87a5-77f37f4d7c9d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:10.053023 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-85d9d0ce-e92f-4ae2-87a5-77f37f4d7c9d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:10.054223 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-85d9d0ce-e92f-4ae2-87a5-77f37f4d7c9d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1739 microversion: 2.20 time: 0.210319 Feb 16 14:32:10.055603 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 451/960] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:32:09 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1739 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:32:11.074363 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-9fcc958c-bfa8-4725-983a-6cf318ee849e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:11.075030 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-9fcc958c-bfa8-4725-983a-6cf318ee849e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:11.083051 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9fcc958c-bfa8-4725-983a-6cf318ee849e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:11.083503 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9fcc958c-bfa8-4725-983a-6cf318ee849e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:11.084323 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9fcc958c-bfa8-4725-983a-6cf318ee849e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:11.084968 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9fcc958c-bfa8-4725-983a-6cf318ee849e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:11.246174 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-9fcc958c-bfa8-4725-983a-6cf318ee849e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:11.254289 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-9fcc958c-bfa8-4725-983a-6cf318ee849e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:11.256659 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-9fcc958c-bfa8-4725-983a-6cf318ee849e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:11.257933 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-9fcc958c-bfa8-4725-983a-6cf318ee849e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1739 microversion: 2.20 time: 0.187889 Feb 16 14:32:11.258569 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 510/961] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:32:11 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:32:12.275618 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-73c73dff-71c2-49d8-853d-84e9c35188b3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:12.276223 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-73c73dff-71c2-49d8-853d-84e9c35188b3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:12.282494 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-73c73dff-71c2-49d8-853d-84e9c35188b3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:12.283011 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-73c73dff-71c2-49d8-853d-84e9c35188b3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:12.283792 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-73c73dff-71c2-49d8-853d-84e9c35188b3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:12.284340 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-73c73dff-71c2-49d8-853d-84e9c35188b3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:12.423529 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-73c73dff-71c2-49d8-853d-84e9c35188b3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:12.432036 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-73c73dff-71c2-49d8-853d-84e9c35188b3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:12.433974 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-73c73dff-71c2-49d8-853d-84e9c35188b3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:12.435237 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-73c73dff-71c2-49d8-853d-84e9c35188b3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1739 microversion: 2.20 time: 0.163362 Feb 16 14:32:12.435809 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 452/962] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:32:12 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:32:13.036902 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-7c3682e6-20e6-4a31-8d9b-d51e034ce2e4 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:13.037707 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-7c3682e6-20e6-4a31-8d9b-d51e034ce2e4 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:13.045189 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7c3682e6-20e6-4a31-8d9b-d51e034ce2e4 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:13.053008 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7c3682e6-20e6-4a31-8d9b-d51e034ce2e4 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:13.053008 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7c3682e6-20e6-4a31-8d9b-d51e034ce2e4 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:13.053008 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7c3682e6-20e6-4a31-8d9b-d51e034ce2e4 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:13.078589 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-7c3682e6-20e6-4a31-8d9b-d51e034ce2e4 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce/os-volume_attachments/fb690fb5-cc28-4334-bfb1-da31ca2bc2b7" status: 200 len: 194 microversion: 2.1 time: 0.045413 Feb 16 14:32:13.079210 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 511/963] 10.222.0.110 () {58 vars in 1417 bytes} [Wed Feb 16 14:32:13 2022] GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce/os-volume_attachments/fb690fb5-cc28-4334-bfb1-da31ca2bc2b7 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:32:13.089719 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-208c7c9c-a682-4d01-a6fa-db225283b785 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:13.090220 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-208c7c9c-a682-4d01-a6fa-db225283b785 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:13.096208 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-208c7c9c-a682-4d01-a6fa-db225283b785 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:13.098813 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-208c7c9c-a682-4d01-a6fa-db225283b785 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:13.098813 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-208c7c9c-a682-4d01-a6fa-db225283b785 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:13.098813 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-208c7c9c-a682-4d01-a6fa-db225283b785 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:13.175560 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-208c7c9c-a682-4d01-a6fa-db225283b785 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lazy-loading 'services' on Instance uuid 9e1bd9c3-d567-4517-8761-d154223724ce {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:32:13.395003 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-208c7c9c-a682-4d01-a6fa-db225283b785 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "DELETE /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce/os-volume_attachments/fb690fb5-cc28-4334-bfb1-da31ca2bc2b7" status: 202 len: 0 microversion: 2.1 time: 0.309468 Feb 16 14:32:13.397086 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 453/964] 10.222.0.110 () {58 vars in 1420 bytes} [Wed Feb 16 14:32:13 2022] DELETE /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce/os-volume_attachments/fb690fb5-cc28-4334-bfb1-da31ca2bc2b7 => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 16 14:32:13.454045 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-b00df8f5-aa4f-47fe-a437-5d99cf0b8104 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:13.454773 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-b00df8f5-aa4f-47fe-a437-5d99cf0b8104 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:13.460635 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b00df8f5-aa4f-47fe-a437-5d99cf0b8104 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:13.461136 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b00df8f5-aa4f-47fe-a437-5d99cf0b8104 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:13.463719 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b00df8f5-aa4f-47fe-a437-5d99cf0b8104 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:13.463719 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b00df8f5-aa4f-47fe-a437-5d99cf0b8104 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:13.603493 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-b00df8f5-aa4f-47fe-a437-5d99cf0b8104 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:13.611084 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-b00df8f5-aa4f-47fe-a437-5d99cf0b8104 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:13.612572 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-b00df8f5-aa4f-47fe-a437-5d99cf0b8104 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:13.613734 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-b00df8f5-aa4f-47fe-a437-5d99cf0b8104 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1721 microversion: 2.20 time: 0.163744 Feb 16 14:32:13.614312 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 512/965] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:32:13 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:32:14.633020 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e6b4f316-8482-4bc0-9fb1-e918bde4552d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:14.633723 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-e6b4f316-8482-4bc0-9fb1-e918bde4552d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:14.639933 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e6b4f316-8482-4bc0-9fb1-e918bde4552d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:14.640385 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e6b4f316-8482-4bc0-9fb1-e918bde4552d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:14.641211 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e6b4f316-8482-4bc0-9fb1-e918bde4552d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:14.641650 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e6b4f316-8482-4bc0-9fb1-e918bde4552d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:14.782109 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-e6b4f316-8482-4bc0-9fb1-e918bde4552d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:14.790295 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-e6b4f316-8482-4bc0-9fb1-e918bde4552d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:14.792659 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-e6b4f316-8482-4bc0-9fb1-e918bde4552d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:14.793853 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-e6b4f316-8482-4bc0-9fb1-e918bde4552d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1721 microversion: 2.20 time: 0.165391 Feb 16 14:32:14.794442 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 454/966] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:32:14 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:32:15.540642 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-42ff3893-9834-47d3-b7de-6a87a058a936 req-81d5b2c5-ce87-4736-8cc3-0f8ab8068e9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "542bf2d6-2c49-48e1-a903-3a14bcfb1b0d", "name": "network-vif-unplugged", "status": "completed", "tag": "c35750d8-fe77-4744-8fd1-c9914d7c2435"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:32:15.546281 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:32:15.546281 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:32:15.553908 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-42ff3893-9834-47d3-b7de-6a87a058a936 req-81d5b2c5-ce87-4736-8cc3-0f8ab8068e9a service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:15.554424 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-42ff3893-9834-47d3-b7de-6a87a058a936 req-81d5b2c5-ce87-4736-8cc3-0f8ab8068e9a service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:15.559763 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-1511deda-1aea-402e-80b8-4d36b58c51a9 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:15.560250 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-1511deda-1aea-402e-80b8-4d36b58c51a9 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:15.566043 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1511deda-1aea-402e-80b8-4d36b58c51a9 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:15.566558 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1511deda-1aea-402e-80b8-4d36b58c51a9 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:15.566893 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-42ff3893-9834-47d3-b7de-6a87a058a936 req-81d5b2c5-ce87-4736-8cc3-0f8ab8068e9a service nova] Creating event network-vif-unplugged:c35750d8-fe77-4744-8fd1-c9914d7c2435 for instance 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d on hv-cinder-80473 Feb 16 14:32:15.567374 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1511deda-1aea-402e-80b8-4d36b58c51a9 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:15.567850 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1511deda-1aea-402e-80b8-4d36b58c51a9 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:15.571991 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-42ff3893-9834-47d3-b7de-6a87a058a936 req-81d5b2c5-ce87-4736-8cc3-0f8ab8068e9a service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035449 Feb 16 14:32:15.573427 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 513/967] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:32:15.598929 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-1511deda-1aea-402e-80b8-4d36b58c51a9 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce/os-volume_attachments/2352f66e-dcdc-4a66-9718-08ba6f20779e" status: 200 len: 194 microversion: 2.1 time: 0.043311 Feb 16 14:32:15.599511 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 455/968] 10.222.0.110 () {58 vars in 1417 bytes} [Wed Feb 16 14:32:15 2022] GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce/os-volume_attachments/2352f66e-dcdc-4a66-9718-08ba6f20779e => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 14:32:15.609943 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-f2188095-4729-4581-88f5-74d56a854127 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:15.610530 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-f2188095-4729-4581-88f5-74d56a854127 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:15.616534 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f2188095-4729-4581-88f5-74d56a854127 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:15.616986 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f2188095-4729-4581-88f5-74d56a854127 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:15.617768 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f2188095-4729-4581-88f5-74d56a854127 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:15.618191 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f2188095-4729-4581-88f5-74d56a854127 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:15.702436 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.objects.instance [None req-f2188095-4729-4581-88f5-74d56a854127 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lazy-loading 'services' on Instance uuid 9e1bd9c3-d567-4517-8761-d154223724ce {{(pid=117031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:32:15.812260 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-25b1ce42-0c4b-49d4-b5df-117bd8fcd64c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:15.812868 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-25b1ce42-0c4b-49d4-b5df-117bd8fcd64c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:15.819163 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-25b1ce42-0c4b-49d4-b5df-117bd8fcd64c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:15.819653 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-25b1ce42-0c4b-49d4-b5df-117bd8fcd64c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:15.820393 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-25b1ce42-0c4b-49d4-b5df-117bd8fcd64c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:15.820833 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-25b1ce42-0c4b-49d4-b5df-117bd8fcd64c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:15.938363 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-f2188095-4729-4581-88f5-74d56a854127 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "DELETE /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce/os-volume_attachments/2352f66e-dcdc-4a66-9718-08ba6f20779e" status: 202 len: 0 microversion: 2.1 time: 0.332273 Feb 16 14:32:15.938936 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 514/969] 10.222.0.110 () {58 vars in 1420 bytes} [Wed Feb 16 14:32:15 2022] DELETE /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce/os-volume_attachments/2352f66e-dcdc-4a66-9718-08ba6f20779e => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 16 14:32:15.964410 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-25b1ce42-0c4b-49d4-b5df-117bd8fcd64c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:15.974199 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-25b1ce42-0c4b-49d4-b5df-117bd8fcd64c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:15.975779 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-25b1ce42-0c4b-49d4-b5df-117bd8fcd64c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:15.976955 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-25b1ce42-0c4b-49d4-b5df-117bd8fcd64c tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1721 microversion: 2.20 time: 0.168630 Feb 16 14:32:15.977567 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 456/970] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:32:15 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:32:16.997352 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-ce92a779-d7aa-472f-a5a2-1fbd51dc3f23 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:16.998187 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-ce92a779-d7aa-472f-a5a2-1fbd51dc3f23 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:17.004237 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ce92a779-d7aa-472f-a5a2-1fbd51dc3f23 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:17.004906 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ce92a779-d7aa-472f-a5a2-1fbd51dc3f23 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:17.005698 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ce92a779-d7aa-472f-a5a2-1fbd51dc3f23 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:17.006140 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ce92a779-d7aa-472f-a5a2-1fbd51dc3f23 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:17.159071 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-ce92a779-d7aa-472f-a5a2-1fbd51dc3f23 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:17.167638 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-ce92a779-d7aa-472f-a5a2-1fbd51dc3f23 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:17.169235 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-ce92a779-d7aa-472f-a5a2-1fbd51dc3f23 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:17.170384 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-ce92a779-d7aa-472f-a5a2-1fbd51dc3f23 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1664 microversion: 2.20 time: 0.178576 Feb 16 14:32:17.170968 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 515/971] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:32:16 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1664 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:32:17.191522 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-502cd8b1-e15a-4da1-9e45-0dc4a1c36097 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "167fb5f2-959a-4ca4-9ecb-4decd219167a"}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:32:17.191522 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-502cd8b1-e15a-4da1-9e45-0dc4a1c36097 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:17.196390 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-502cd8b1-e15a-4da1-9e45-0dc4a1c36097 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:17.196856 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-502cd8b1-e15a-4da1-9e45-0dc4a1c36097 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:17.197653 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-502cd8b1-e15a-4da1-9e45-0dc4a1c36097 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:17.198282 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-502cd8b1-e15a-4da1-9e45-0dc4a1c36097 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:18.160088 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-5933b378-13d2-46e5-8a6f-64ed891ba0ef tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:18.161058 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-5933b378-13d2-46e5-8a6f-64ed891ba0ef tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:18.166016 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-502cd8b1-e15a-4da1-9e45-0dc4a1c36097 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "POST /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.981360 Feb 16 14:32:18.167526 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 457/972] 10.222.0.110 () {62 vars in 1368 bytes} [Wed Feb 16 14:32:17 2022] POST /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d/os-volume_attachments => generated 188 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Feb 16 14:32:18.168604 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5933b378-13d2-46e5-8a6f-64ed891ba0ef tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:18.169151 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5933b378-13d2-46e5-8a6f-64ed891ba0ef tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:18.170009 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5933b378-13d2-46e5-8a6f-64ed891ba0ef tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:18.170555 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5933b378-13d2-46e5-8a6f-64ed891ba0ef tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:18.202747 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-5933b378-13d2-46e5-8a6f-64ed891ba0ef tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046299 Feb 16 14:32:18.203621 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 516/973] 10.222.0.110 () {58 vars in 1306 bytes} [Wed Feb 16 14:32:18 2022] GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 16 14:32:18.277050 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-1e96b453-8c91-434d-9285-f6bfdaad443a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:18.277567 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-1e96b453-8c91-434d-9285-f6bfdaad443a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:18.283845 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1e96b453-8c91-434d-9285-f6bfdaad443a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:18.284329 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1e96b453-8c91-434d-9285-f6bfdaad443a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:18.285117 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1e96b453-8c91-434d-9285-f6bfdaad443a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:18.285556 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1e96b453-8c91-434d-9285-f6bfdaad443a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:18.305282 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-45fc146f-5874-4b66-b231-b63f5aceff98 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:18.306189 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-45fc146f-5874-4b66-b231-b63f5aceff98 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:18.315830 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-45fc146f-5874-4b66-b231-b63f5aceff98 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:18.316257 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-45fc146f-5874-4b66-b231-b63f5aceff98 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:18.317057 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-45fc146f-5874-4b66-b231-b63f5aceff98 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:18.317490 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-45fc146f-5874-4b66-b231-b63f5aceff98 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:18.347524 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-45fc146f-5874-4b66-b231-b63f5aceff98 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045899 Feb 16 14:32:18.348254 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 517/974] 10.222.0.110 () {58 vars in 1306 bytes} [Wed Feb 16 14:32:18 2022] GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Feb 16 14:32:18.404949 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-7c2bd1d5-2c2d-49f1-8b89-b8d17c2ae050 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:18.405442 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-7c2bd1d5-2c2d-49f1-8b89-b8d17c2ae050 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:18.411314 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7c2bd1d5-2c2d-49f1-8b89-b8d17c2ae050 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:18.411762 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7c2bd1d5-2c2d-49f1-8b89-b8d17c2ae050 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:18.412532 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7c2bd1d5-2c2d-49f1-8b89-b8d17c2ae050 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:18.412966 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7c2bd1d5-2c2d-49f1-8b89-b8d17c2ae050 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:18.439420 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-7c2bd1d5-2c2d-49f1-8b89-b8d17c2ae050 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Going to try to terminate instance {{(pid=117031) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 16 14:32:18.757046 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-7c2bd1d5-2c2d-49f1-8b89-b8d17c2ae050 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "DELETE /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce" status: 204 len: 0 microversion: 2.1 time: 0.354800 Feb 16 14:32:18.757731 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 518/975] 10.222.0.110 () {58 vars in 1243 bytes} [Wed Feb 16 14:32:18 2022] DELETE /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Feb 16 14:32:18.766326 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-d97e667b-62e4-4c72-b3d0-309e6be6348c tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:18.767056 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-d97e667b-62e4-4c72-b3d0-309e6be6348c tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:18.773073 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d97e667b-62e4-4c72-b3d0-309e6be6348c tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:18.773517 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d97e667b-62e4-4c72-b3d0-309e6be6348c tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:18.774301 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d97e667b-62e4-4c72-b3d0-309e6be6348c tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:18.774909 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d97e667b-62e4-4c72-b3d0-309e6be6348c tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:18.916458 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-d97e667b-62e4-4c72-b3d0-309e6be6348c tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:18.924249 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-d97e667b-62e4-4c72-b3d0-309e6be6348c tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce" status: 200 len: 1678 microversion: 2.1 time: 0.161614 Feb 16 14:32:18.924824 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 519/976] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:32:18 2022] GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:32:18.994717 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-1e96b453-8c91-434d-9285-f6bfdaad443a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "DELETE /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d/os-volume_attachments/167fb5f2-959a-4ca4-9ecb-4decd219167a" status: 202 len: 0 microversion: 2.20 time: 0.721806 Feb 16 14:32:18.995328 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 458/977] 10.222.0.110 () {60 vars in 1461 bytes} [Wed Feb 16 14:32:18 2022] DELETE /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d/os-volume_attachments/167fb5f2-959a-4ca4-9ecb-4decd219167a => generated 0 bytes in 723 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 16 14:32:19.049792 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-f385af0a-1f6e-4da8-b7b2-d5d3ace5b8d8 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:32:19.050356 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-f385af0a-1f6e-4da8-b7b2-d5d3ace5b8d8 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:19.056186 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f385af0a-1f6e-4da8-b7b2-d5d3ace5b8d8 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:19.056634 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f385af0a-1f6e-4da8-b7b2-d5d3ace5b8d8 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:19.057410 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f385af0a-1f6e-4da8-b7b2-d5d3ace5b8d8 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:19.057846 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f385af0a-1f6e-4da8-b7b2-d5d3ace5b8d8 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:19.311818 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-f385af0a-1f6e-4da8-b7b2-d5d3ace5b8d8 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "POST /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d/action" status: 202 len: 0 microversion: 2.20 time: 0.265696 Feb 16 14:32:19.312744 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 520/978] 10.222.0.110 () {62 vars in 1323 bytes} [Wed Feb 16 14:32:19 2022] POST /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Feb 16 14:32:19.322400 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a4fa99e8-f2ce-4f5c-9209-613f2fff54d0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:19.323043 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a4fa99e8-f2ce-4f5c-9209-613f2fff54d0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:19.330187 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a4fa99e8-f2ce-4f5c-9209-613f2fff54d0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:19.330657 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a4fa99e8-f2ce-4f5c-9209-613f2fff54d0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:19.331451 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a4fa99e8-f2ce-4f5c-9209-613f2fff54d0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:19.331890 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a4fa99e8-f2ce-4f5c-9209-613f2fff54d0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:19.481296 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a4fa99e8-f2ce-4f5c-9209-613f2fff54d0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:19.489479 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a4fa99e8-f2ce-4f5c-9209-613f2fff54d0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:19.491340 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a4fa99e8-f2ce-4f5c-9209-613f2fff54d0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:19.492733 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a4fa99e8-f2ce-4f5c-9209-613f2fff54d0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1672 microversion: 2.20 time: 0.174212 Feb 16 14:32:19.493827 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 459/979] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:32:19 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1672 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:32:19.942369 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-ea3c804e-03a2-4f1d-9cb0-5816c454b47d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:19.942692 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-ea3c804e-03a2-4f1d-9cb0-5816c454b47d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:19.948983 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ea3c804e-03a2-4f1d-9cb0-5816c454b47d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:19.949445 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ea3c804e-03a2-4f1d-9cb0-5816c454b47d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:19.950226 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ea3c804e-03a2-4f1d-9cb0-5816c454b47d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:19.950691 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ea3c804e-03a2-4f1d-9cb0-5816c454b47d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:20.083511 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-ea3c804e-03a2-4f1d-9cb0-5816c454b47d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:20.091469 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-ea3c804e-03a2-4f1d-9cb0-5816c454b47d tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce" status: 200 len: 1678 microversion: 2.1 time: 0.153759 Feb 16 14:32:20.092044 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 521/980] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:32:19 2022] GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:32:20.510769 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f2fc071a-19d6-42af-ae95-6624f5ca39b2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:20.512147 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f2fc071a-19d6-42af-ae95-6624f5ca39b2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:20.519661 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f2fc071a-19d6-42af-ae95-6624f5ca39b2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:20.520164 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f2fc071a-19d6-42af-ae95-6624f5ca39b2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:20.520985 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f2fc071a-19d6-42af-ae95-6624f5ca39b2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:20.521423 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f2fc071a-19d6-42af-ae95-6624f5ca39b2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:20.676145 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f2fc071a-19d6-42af-ae95-6624f5ca39b2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:20.685241 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f2fc071a-19d6-42af-ae95-6624f5ca39b2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:20.686806 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f2fc071a-19d6-42af-ae95-6624f5ca39b2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:20.687972 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f2fc071a-19d6-42af-ae95-6624f5ca39b2 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1672 microversion: 2.20 time: 0.181131 Feb 16 14:32:20.688524 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 460/981] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:32:20 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1672 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:32:21.107948 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-6d72976d-329a-4ed2-8b87-9e5cc3fa545e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:21.108571 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-6d72976d-329a-4ed2-8b87-9e5cc3fa545e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:21.116667 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-6d72976d-329a-4ed2-8b87-9e5cc3fa545e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:21.117132 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-6d72976d-329a-4ed2-8b87-9e5cc3fa545e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:21.117926 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-6d72976d-329a-4ed2-8b87-9e5cc3fa545e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:21.118366 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-6d72976d-329a-4ed2-8b87-9e5cc3fa545e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:21.270527 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-6d72976d-329a-4ed2-8b87-9e5cc3fa545e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:21.284028 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-6d72976d-329a-4ed2-8b87-9e5cc3fa545e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce" status: 200 len: 1678 microversion: 2.1 time: 0.175576 Feb 16 14:32:21.284028 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 522/982] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:32:21 2022] GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:32:21.707680 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b66bb004-1fe0-4622-a729-fe2c36e035d0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:21.708290 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b66bb004-1fe0-4622-a729-fe2c36e035d0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:21.714984 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b66bb004-1fe0-4622-a729-fe2c36e035d0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:21.715418 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b66bb004-1fe0-4622-a729-fe2c36e035d0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:21.716204 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b66bb004-1fe0-4622-a729-fe2c36e035d0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:21.716639 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b66bb004-1fe0-4622-a729-fe2c36e035d0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:22.004651 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b66bb004-1fe0-4622-a729-fe2c36e035d0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:22.013443 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b66bb004-1fe0-4622-a729-fe2c36e035d0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:22.015164 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b66bb004-1fe0-4622-a729-fe2c36e035d0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:22.016457 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b66bb004-1fe0-4622-a729-fe2c36e035d0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1730 microversion: 2.20 time: 0.312626 Feb 16 14:32:22.017096 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 461/983] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:32:21 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1730 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:32:22.298027 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-93cc3243-56e9-4af8-927c-cb7c7ee91458 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:22.298675 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-93cc3243-56e9-4af8-927c-cb7c7ee91458 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:22.306058 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-93cc3243-56e9-4af8-927c-cb7c7ee91458 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:22.306508 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-93cc3243-56e9-4af8-927c-cb7c7ee91458 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:22.307533 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-93cc3243-56e9-4af8-927c-cb7c7ee91458 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:22.308441 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-93cc3243-56e9-4af8-927c-cb7c7ee91458 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:22.381150 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-93cc3243-56e9-4af8-927c-cb7c7ee91458 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:22.389706 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-93cc3243-56e9-4af8-927c-cb7c7ee91458 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce" status: 200 len: 1610 microversion: 2.1 time: 0.096546 Feb 16 14:32:22.390282 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 523/984] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:32:22 2022] GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce => generated 1610 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:32:23.024097 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-93a0bc97-4c35-4d00-b4d7-6f527969b4a9 req-2005b94e-ab36-49ae-beab-4765e3a3c412 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e1bd9c3-d567-4517-8761-d154223724ce", "name": "network-vif-deleted", "tag": "c29a0894-7a63-42f0-85d5-e534663d09c0"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:32:23.026462 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:32:23.026462 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: warnings.warn(msg) Feb 16 14:32:23.039004 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-404128d0-d0cc-4abf-a613-3f0fd69fe7c4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:23.043917 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-404128d0-d0cc-4abf-a613-3f0fd69fe7c4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:23.049819 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-404128d0-d0cc-4abf-a613-3f0fd69fe7c4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:23.052674 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-93a0bc97-4c35-4d00-b4d7-6f527969b4a9 req-2005b94e-ab36-49ae-beab-4765e3a3c412 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:23.053610 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-404128d0-d0cc-4abf-a613-3f0fd69fe7c4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:23.054676 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-404128d0-d0cc-4abf-a613-3f0fd69fe7c4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:23.055427 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-93a0bc97-4c35-4d00-b4d7-6f527969b4a9 req-2005b94e-ab36-49ae-beab-4765e3a3c412 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:23.056166 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-404128d0-d0cc-4abf-a613-3f0fd69fe7c4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:23.084783 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-93a0bc97-4c35-4d00-b4d7-6f527969b4a9 req-2005b94e-ab36-49ae-beab-4765e3a3c412 service nova] Creating event network-vif-deleted:c29a0894-7a63-42f0-85d5-e534663d09c0 for instance 9e1bd9c3-d567-4517-8761-d154223724ce on hv-cinder-80473 Feb 16 14:32:23.094097 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-93a0bc97-4c35-4d00-b4d7-6f527969b4a9 req-2005b94e-ab36-49ae-beab-4765e3a3c412 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074068 Feb 16 14:32:23.097640 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 462/985] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:32:23.233450 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-404128d0-d0cc-4abf-a613-3f0fd69fe7c4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:23.242145 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-404128d0-d0cc-4abf-a613-3f0fd69fe7c4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:23.243905 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-404128d0-d0cc-4abf-a613-3f0fd69fe7c4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:23.247973 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-404128d0-d0cc-4abf-a613-3f0fd69fe7c4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1730 microversion: 2.20 time: 0.212893 Feb 16 14:32:23.247973 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 524/986] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:32:23 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1730 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:32:23.409486 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-d1111d36-3693-4ca4-84f6-f8cf8ac6843c tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:23.410186 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-d1111d36-3693-4ca4-84f6-f8cf8ac6843c tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:23.417914 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d1111d36-3693-4ca4-84f6-f8cf8ac6843c tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:23.418369 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d1111d36-3693-4ca4-84f6-f8cf8ac6843c tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:23.419300 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d1111d36-3693-4ca4-84f6-f8cf8ac6843c tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:23.419736 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d1111d36-3693-4ca4-84f6-f8cf8ac6843c tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:23.459112 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d1111d36-3693-4ca4-84f6-f8cf8ac6843c tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:23.459890 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d1111d36-3693-4ca4-84f6-f8cf8ac6843c tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:23.460844 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-d1111d36-3693-4ca4-84f6-f8cf8ac6843c tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lazy-loading 'fault' on Instance uuid 9e1bd9c3-d567-4517-8761-d154223724ce {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:32:23.512880 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d1111d36-3693-4ca4-84f6-f8cf8ac6843c tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:23.520624 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-d1111d36-3693-4ca4-84f6-f8cf8ac6843c tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce" status: 200 len: 1331 microversion: 2.1 time: 0.115832 Feb 16 14:32:23.521190 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 463/987] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:32:23 2022] GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce => generated 1331 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:32:24.267264 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-08cbfd97-0f42-4ca3-b3da-6ca979252a40 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:24.268674 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-08cbfd97-0f42-4ca3-b3da-6ca979252a40 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:24.276225 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-08cbfd97-0f42-4ca3-b3da-6ca979252a40 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:24.277520 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-08cbfd97-0f42-4ca3-b3da-6ca979252a40 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:24.278647 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-08cbfd97-0f42-4ca3-b3da-6ca979252a40 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:24.279292 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-08cbfd97-0f42-4ca3-b3da-6ca979252a40 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:24.529972 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-08cbfd97-0f42-4ca3-b3da-6ca979252a40 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:24.543017 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-0a880c64-13e1-4b99-af12-27309ec89cd1 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:24.544386 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-0a880c64-13e1-4b99-af12-27309ec89cd1 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:24.554717 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0a880c64-13e1-4b99-af12-27309ec89cd1 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:24.555611 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0a880c64-13e1-4b99-af12-27309ec89cd1 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:24.562095 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-08cbfd97-0f42-4ca3-b3da-6ca979252a40 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:24.562539 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0a880c64-13e1-4b99-af12-27309ec89cd1 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:24.563258 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0a880c64-13e1-4b99-af12-27309ec89cd1 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:24.564341 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-08cbfd97-0f42-4ca3-b3da-6ca979252a40 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:24.572473 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-08cbfd97-0f42-4ca3-b3da-6ca979252a40 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1730 microversion: 2.20 time: 0.311881 Feb 16 14:32:24.573102 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 525/988] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:32:24 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1730 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:32:24.633145 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0a880c64-13e1-4b99-af12-27309ec89cd1 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:24.633597 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0a880c64-13e1-4b99-af12-27309ec89cd1 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:24.634099 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-0a880c64-13e1-4b99-af12-27309ec89cd1 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lazy-loading 'fault' on Instance uuid 9e1bd9c3-d567-4517-8761-d154223724ce {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:32:24.681798 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-0a880c64-13e1-4b99-af12-27309ec89cd1 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:24.692088 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-0a880c64-13e1-4b99-af12-27309ec89cd1 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce" status: 200 len: 1331 microversion: 2.1 time: 0.153331 Feb 16 14:32:24.692675 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 464/989] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:32:24 2022] GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce => generated 1331 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:32:25.596822 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-d7785d12-ffc7-4b40-af09-26158926404d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:25.597558 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-d7785d12-ffc7-4b40-af09-26158926404d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:25.604464 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d7785d12-ffc7-4b40-af09-26158926404d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:25.605134 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d7785d12-ffc7-4b40-af09-26158926404d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:25.605923 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d7785d12-ffc7-4b40-af09-26158926404d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:25.606434 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d7785d12-ffc7-4b40-af09-26158926404d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:25.709884 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-9ff03cb4-444d-4502-b2b0-ac1b56760789 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:25.711193 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-9ff03cb4-444d-4502-b2b0-ac1b56760789 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:25.722724 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9ff03cb4-444d-4502-b2b0-ac1b56760789 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:25.723517 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9ff03cb4-444d-4502-b2b0-ac1b56760789 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:25.724468 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9ff03cb4-444d-4502-b2b0-ac1b56760789 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:25.725081 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9ff03cb4-444d-4502-b2b0-ac1b56760789 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:25.763045 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9ff03cb4-444d-4502-b2b0-ac1b56760789 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:25.763499 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9ff03cb4-444d-4502-b2b0-ac1b56760789 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:25.763958 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-9ff03cb4-444d-4502-b2b0-ac1b56760789 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lazy-loading 'fault' on Instance uuid 9e1bd9c3-d567-4517-8761-d154223724ce {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:32:25.782149 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-d7785d12-ffc7-4b40-af09-26158926404d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:25.790446 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-d7785d12-ffc7-4b40-af09-26158926404d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:25.792077 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-d7785d12-ffc7-4b40-af09-26158926404d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:25.796077 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-d7785d12-ffc7-4b40-af09-26158926404d tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1730 microversion: 2.20 time: 0.202627 Feb 16 14:32:25.797309 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 526/990] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:32:25 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1730 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:32:25.818968 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-9ff03cb4-444d-4502-b2b0-ac1b56760789 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:25.828012 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-9ff03cb4-444d-4502-b2b0-ac1b56760789 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce" status: 200 len: 1331 microversion: 2.1 time: 0.122530 Feb 16 14:32:25.828877 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 465/991] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:32:25 2022] GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce => generated 1331 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:32:26.819511 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-3a49c667-49d9-4911-b64a-e627e02aa64a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:26.820302 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-3a49c667-49d9-4911-b64a-e627e02aa64a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:26.828908 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3a49c667-49d9-4911-b64a-e627e02aa64a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:26.829288 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3a49c667-49d9-4911-b64a-e627e02aa64a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:26.830322 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3a49c667-49d9-4911-b64a-e627e02aa64a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:26.831028 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3a49c667-49d9-4911-b64a-e627e02aa64a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:26.844965 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-2692f4b6-7c14-497b-bbf1-ab84f202d2da tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:26.846223 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-2692f4b6-7c14-497b-bbf1-ab84f202d2da tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:26.864668 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2692f4b6-7c14-497b-bbf1-ab84f202d2da tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:26.865408 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2692f4b6-7c14-497b-bbf1-ab84f202d2da tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:26.866408 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2692f4b6-7c14-497b-bbf1-ab84f202d2da tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:26.867051 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2692f4b6-7c14-497b-bbf1-ab84f202d2da tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:26.906611 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2692f4b6-7c14-497b-bbf1-ab84f202d2da tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:26.907094 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2692f4b6-7c14-497b-bbf1-ab84f202d2da tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:26.907556 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-2692f4b6-7c14-497b-bbf1-ab84f202d2da tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lazy-loading 'fault' on Instance uuid 9e1bd9c3-d567-4517-8761-d154223724ce {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:32:26.961875 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-2692f4b6-7c14-497b-bbf1-ab84f202d2da tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:26.970708 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-2692f4b6-7c14-497b-bbf1-ab84f202d2da tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce" status: 200 len: 1331 microversion: 2.1 time: 0.129300 Feb 16 14:32:26.974673 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 466/992] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:32:26 2022] GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce => generated 1331 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:32:27.015845 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-3a49c667-49d9-4911-b64a-e627e02aa64a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:27.024302 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-3a49c667-49d9-4911-b64a-e627e02aa64a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:27.026193 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-3a49c667-49d9-4911-b64a-e627e02aa64a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:27.028526 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-3a49c667-49d9-4911-b64a-e627e02aa64a tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1730 microversion: 2.20 time: 0.213009 Feb 16 14:32:27.028907 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 527/993] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:32:26 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1730 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:32:27.990052 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-4fc92cb6-084a-4010-9633-38ccf12527fd tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:27.990780 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-4fc92cb6-084a-4010-9633-38ccf12527fd tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:27.997950 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4fc92cb6-084a-4010-9633-38ccf12527fd tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:27.998501 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4fc92cb6-084a-4010-9633-38ccf12527fd tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:27.999373 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4fc92cb6-084a-4010-9633-38ccf12527fd tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:27.999878 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4fc92cb6-084a-4010-9633-38ccf12527fd tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:28.031681 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4fc92cb6-084a-4010-9633-38ccf12527fd tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:28.032260 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4fc92cb6-084a-4010-9633-38ccf12527fd tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:28.032785 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-4fc92cb6-084a-4010-9633-38ccf12527fd tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lazy-loading 'fault' on Instance uuid 9e1bd9c3-d567-4517-8761-d154223724ce {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:32:28.048583 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-635ca9ee-0b97-409e-8968-1bf65c675290 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:28.049247 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-635ca9ee-0b97-409e-8968-1bf65c675290 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:28.055873 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-635ca9ee-0b97-409e-8968-1bf65c675290 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:28.056584 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-635ca9ee-0b97-409e-8968-1bf65c675290 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:28.057387 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-635ca9ee-0b97-409e-8968-1bf65c675290 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:28.058719 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-635ca9ee-0b97-409e-8968-1bf65c675290 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:28.082819 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-4fc92cb6-084a-4010-9633-38ccf12527fd tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:28.091355 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-4fc92cb6-084a-4010-9633-38ccf12527fd tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce" status: 200 len: 1331 microversion: 2.1 time: 0.105871 Feb 16 14:32:28.099190 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 467/994] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:32:27 2022] GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce => generated 1331 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:32:28.200837 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-635ca9ee-0b97-409e-8968-1bf65c675290 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:28.213550 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-635ca9ee-0b97-409e-8968-1bf65c675290 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:28.215555 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-635ca9ee-0b97-409e-8968-1bf65c675290 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:28.216721 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-635ca9ee-0b97-409e-8968-1bf65c675290 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1730 microversion: 2.20 time: 0.171949 Feb 16 14:32:28.217283 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 528/995] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:32:28 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Feb 16 14:32:29.108561 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-7e297a9f-e241-42ae-bd4f-14374108594e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:29.109157 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-7e297a9f-e241-42ae-bd4f-14374108594e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:29.115883 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7e297a9f-e241-42ae-bd4f-14374108594e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:29.116352 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7e297a9f-e241-42ae-bd4f-14374108594e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:29.117147 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7e297a9f-e241-42ae-bd4f-14374108594e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:29.117586 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7e297a9f-e241-42ae-bd4f-14374108594e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:29.149864 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7e297a9f-e241-42ae-bd4f-14374108594e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:29.150322 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-7e297a9f-e241-42ae-bd4f-14374108594e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:29.150802 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-7e297a9f-e241-42ae-bd4f-14374108594e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lazy-loading 'fault' on Instance uuid 9e1bd9c3-d567-4517-8761-d154223724ce {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:32:29.193405 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-7e297a9f-e241-42ae-bd4f-14374108594e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:29.203779 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-7e297a9f-e241-42ae-bd4f-14374108594e tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce" status: 200 len: 1331 microversion: 2.1 time: 0.099043 Feb 16 14:32:29.204364 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 468/996] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:32:29 2022] GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:32:29.234799 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-a61d5401-b868-4149-ae8b-d9afe1bb55c9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:29.235435 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-a61d5401-b868-4149-ae8b-d9afe1bb55c9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:29.241742 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a61d5401-b868-4149-ae8b-d9afe1bb55c9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:29.242182 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a61d5401-b868-4149-ae8b-d9afe1bb55c9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:29.242990 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a61d5401-b868-4149-ae8b-d9afe1bb55c9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:29.243423 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a61d5401-b868-4149-ae8b-d9afe1bb55c9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:29.390797 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-a61d5401-b868-4149-ae8b-d9afe1bb55c9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:29.399144 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-a61d5401-b868-4149-ae8b-d9afe1bb55c9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:29.400720 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-a61d5401-b868-4149-ae8b-d9afe1bb55c9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:29.402525 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-a61d5401-b868-4149-ae8b-d9afe1bb55c9 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1730 microversion: 2.20 time: 0.170836 Feb 16 14:32:29.403108 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 529/997] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:32:29 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:32:30.221309 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-3f7a6a07-81e8-4957-9931-fc6a52177943 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:30.221888 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-3f7a6a07-81e8-4957-9931-fc6a52177943 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:30.230202 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3f7a6a07-81e8-4957-9931-fc6a52177943 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:30.230743 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3f7a6a07-81e8-4957-9931-fc6a52177943 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:30.231665 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3f7a6a07-81e8-4957-9931-fc6a52177943 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:30.232104 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3f7a6a07-81e8-4957-9931-fc6a52177943 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:30.265604 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3f7a6a07-81e8-4957-9931-fc6a52177943 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:30.266061 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3f7a6a07-81e8-4957-9931-fc6a52177943 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:30.266547 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-3f7a6a07-81e8-4957-9931-fc6a52177943 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lazy-loading 'fault' on Instance uuid 9e1bd9c3-d567-4517-8761-d154223724ce {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:32:30.309365 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3f7a6a07-81e8-4957-9931-fc6a52177943 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:30.318023 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-3f7a6a07-81e8-4957-9931-fc6a52177943 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce" status: 200 len: 1331 microversion: 2.1 time: 0.100363 Feb 16 14:32:30.318602 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 469/998] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:32:30 2022] GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce => generated 1331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:32:30.420442 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-e73a0801-768a-4cb0-973b-ca485a388fa4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:30.421031 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-e73a0801-768a-4cb0-973b-ca485a388fa4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:30.427726 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e73a0801-768a-4cb0-973b-ca485a388fa4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:30.428281 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e73a0801-768a-4cb0-973b-ca485a388fa4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:30.428959 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e73a0801-768a-4cb0-973b-ca485a388fa4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:30.429396 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e73a0801-768a-4cb0-973b-ca485a388fa4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:30.579918 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-e73a0801-768a-4cb0-973b-ca485a388fa4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:30.588297 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-e73a0801-768a-4cb0-973b-ca485a388fa4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:30.591356 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-e73a0801-768a-4cb0-973b-ca485a388fa4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:30.592113 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-e73a0801-768a-4cb0-973b-ca485a388fa4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1730 microversion: 2.20 time: 0.176178 Feb 16 14:32:30.592678 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 530/999] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:32:30 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:32:31.335247 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-eb9d5a87-cf15-4103-9940-21998a2931d5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:31.336048 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-eb9d5a87-cf15-4103-9940-21998a2931d5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:31.350360 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-eb9d5a87-cf15-4103-9940-21998a2931d5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:31.350833 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-eb9d5a87-cf15-4103-9940-21998a2931d5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:31.351671 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-eb9d5a87-cf15-4103-9940-21998a2931d5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:31.352116 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-eb9d5a87-cf15-4103-9940-21998a2931d5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:31.400447 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-eb9d5a87-cf15-4103-9940-21998a2931d5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:31.410558 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-eb9d5a87-cf15-4103-9940-21998a2931d5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:31.410558 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-eb9d5a87-cf15-4103-9940-21998a2931d5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lazy-loading 'fault' on Instance uuid 9e1bd9c3-d567-4517-8761-d154223724ce {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:32:31.443622 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-eb9d5a87-cf15-4103-9940-21998a2931d5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:31.453670 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-eb9d5a87-cf15-4103-9940-21998a2931d5 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce" status: 200 len: 1331 microversion: 2.1 time: 0.122146 Feb 16 14:32:31.454539 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 470/1000] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:32:31 2022] GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce => generated 1331 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:32:31.611195 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-880e985c-6cab-49d1-8933-77aa71758c20 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:31.612929 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-880e985c-6cab-49d1-8933-77aa71758c20 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:31.621149 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-880e985c-6cab-49d1-8933-77aa71758c20 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:31.621608 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-880e985c-6cab-49d1-8933-77aa71758c20 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:31.622438 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-880e985c-6cab-49d1-8933-77aa71758c20 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:31.623101 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-880e985c-6cab-49d1-8933-77aa71758c20 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:31.782654 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-880e985c-6cab-49d1-8933-77aa71758c20 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:31.795828 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-880e985c-6cab-49d1-8933-77aa71758c20 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:31.803918 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-880e985c-6cab-49d1-8933-77aa71758c20 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:31.805131 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-880e985c-6cab-49d1-8933-77aa71758c20 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1730 microversion: 2.20 time: 0.198983 Feb 16 14:32:31.805886 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 531/1001] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:32:31 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1730 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:32:32.473064 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-153748fe-b179-4b64-9417-8e59723f70c2 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:32.474574 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-153748fe-b179-4b64-9417-8e59723f70c2 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:32.482154 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-153748fe-b179-4b64-9417-8e59723f70c2 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:32.482722 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-153748fe-b179-4b64-9417-8e59723f70c2 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:32.483600 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-153748fe-b179-4b64-9417-8e59723f70c2 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:32.484379 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-153748fe-b179-4b64-9417-8e59723f70c2 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:32.520267 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-153748fe-b179-4b64-9417-8e59723f70c2 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:32.520724 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-153748fe-b179-4b64-9417-8e59723f70c2 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:32.521184 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-153748fe-b179-4b64-9417-8e59723f70c2 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lazy-loading 'fault' on Instance uuid 9e1bd9c3-d567-4517-8761-d154223724ce {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:32:32.567589 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-153748fe-b179-4b64-9417-8e59723f70c2 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdbb57cd56c5450aacce437150585ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48b56501b0a49829c4522b171dd1159', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:32.579334 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-153748fe-b179-4b64-9417-8e59723f70c2 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce" status: 200 len: 1331 microversion: 2.1 time: 0.110559 Feb 16 14:32:32.585864 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 471/1002] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:32:32 2022] GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce => generated 1331 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:32:32.823100 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-f602d43c-ef92-4430-832d-78d0576c7806 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:32.824493 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-f602d43c-ef92-4430-832d-78d0576c7806 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:32.831350 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f602d43c-ef92-4430-832d-78d0576c7806 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:32.831856 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f602d43c-ef92-4430-832d-78d0576c7806 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:32.832713 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f602d43c-ef92-4430-832d-78d0576c7806 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:32.833151 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f602d43c-ef92-4430-832d-78d0576c7806 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:32.982289 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-f602d43c-ef92-4430-832d-78d0576c7806 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:32.991008 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-f602d43c-ef92-4430-832d-78d0576c7806 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:32.995878 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-f602d43c-ef92-4430-832d-78d0576c7806 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:32.995878 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-f602d43c-ef92-4430-832d-78d0576c7806 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1730 microversion: 2.20 time: 0.174291 Feb 16 14:32:32.995878 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 532/1003] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:32:32 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:32:33.595835 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e7f24111-b695-4976-a684-dc43a24de6bc tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:33.596453 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-e7f24111-b695-4976-a684-dc43a24de6bc tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:33.602309 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e7f24111-b695-4976-a684-dc43a24de6bc tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:33.602800 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e7f24111-b695-4976-a684-dc43a24de6bc tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:33.603600 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e7f24111-b695-4976-a684-dc43a24de6bc tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:33.604044 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e7f24111-b695-4976-a684-dc43a24de6bc tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:33.619159 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-e7f24111-b695-4976-a684-dc43a24de6bc tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] HTTP exception thrown: Instance 9e1bd9c3-d567-4517-8761-d154223724ce could not be found. Feb 16 14:32:33.619777 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e7f24111-b695-4976-a684-dc43a24de6bc tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Returning 404 to user: Instance 9e1bd9c3-d567-4517-8761-d154223724ce could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:32:33.621516 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-e7f24111-b695-4976-a684-dc43a24de6bc tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce" status: 404 len: 111 microversion: 2.1 time: 0.029473 Feb 16 14:32:33.625568 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 472/1004] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:32:33 2022] GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 14:32:33.631058 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-ef7493f1-36ce-4a14-aea0-c52ab7a2ca10 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '.version_select at 0x7f2990f1bb80>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:33.738325 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-ef7493f1-36ce-4a14-aea0-c52ab7a2ca10 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1396104879" status: 202 len: 0 microversion: 2.1 time: 0.111146 Feb 16 14:32:33.739035 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 533/1005] 10.222.0.110 () {58 vars in 1225 bytes} [Wed Feb 16 14:32:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1396104879 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 14:32:34.012749 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a25d6d54-b487-469f-baef-9772ef3b9e51 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:34.013519 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a25d6d54-b487-469f-baef-9772ef3b9e51 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:34.019726 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a25d6d54-b487-469f-baef-9772ef3b9e51 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:34.025271 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a25d6d54-b487-469f-baef-9772ef3b9e51 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:34.025271 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a25d6d54-b487-469f-baef-9772ef3b9e51 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:34.025271 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a25d6d54-b487-469f-baef-9772ef3b9e51 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:34.375832 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a25d6d54-b487-469f-baef-9772ef3b9e51 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:34.375832 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a25d6d54-b487-469f-baef-9772ef3b9e51 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:34.376303 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a25d6d54-b487-469f-baef-9772ef3b9e51 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:34.376303 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a25d6d54-b487-469f-baef-9772ef3b9e51 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1730 microversion: 2.20 time: 0.367026 Feb 16 14:32:34.385551 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 473/1006] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:32:34 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1730 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:32:35.395081 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-faa5e5fd-bf75-4c0a-b38a-ac340d075cd8 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:35.395841 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-faa5e5fd-bf75-4c0a-b38a-ac340d075cd8 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:35.402289 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-faa5e5fd-bf75-4c0a-b38a-ac340d075cd8 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:35.402763 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-faa5e5fd-bf75-4c0a-b38a-ac340d075cd8 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:35.403582 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-faa5e5fd-bf75-4c0a-b38a-ac340d075cd8 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:35.404014 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-faa5e5fd-bf75-4c0a-b38a-ac340d075cd8 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:35.539428 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-faa5e5fd-bf75-4c0a-b38a-ac340d075cd8 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:35.548293 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-faa5e5fd-bf75-4c0a-b38a-ac340d075cd8 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:35.550727 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-faa5e5fd-bf75-4c0a-b38a-ac340d075cd8 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:35.550979 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-faa5e5fd-bf75-4c0a-b38a-ac340d075cd8 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1730 microversion: 2.20 time: 0.160251 Feb 16 14:32:35.551536 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 534/1007] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:32:35 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:32:36.569231 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-378163ee-ac74-4b56-85f0-2beeb0e0dde3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:36.569847 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-378163ee-ac74-4b56-85f0-2beeb0e0dde3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:36.578235 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-378163ee-ac74-4b56-85f0-2beeb0e0dde3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:36.578733 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-378163ee-ac74-4b56-85f0-2beeb0e0dde3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:36.579954 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-378163ee-ac74-4b56-85f0-2beeb0e0dde3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:36.579954 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-378163ee-ac74-4b56-85f0-2beeb0e0dde3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:36.715783 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-378163ee-ac74-4b56-85f0-2beeb0e0dde3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:36.724141 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-378163ee-ac74-4b56-85f0-2beeb0e0dde3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:36.726013 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-378163ee-ac74-4b56-85f0-2beeb0e0dde3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:36.726848 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-378163ee-ac74-4b56-85f0-2beeb0e0dde3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1730 microversion: 2.20 time: 0.161402 Feb 16 14:32:36.727400 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 474/1008] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:32:36 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:32:37.468018 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-aa503c3b-7620-47f3-8c45-dac7867a3000 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:37.468534 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-aa503c3b-7620-47f3-8c45-dac7867a3000 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:37.474887 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-aa503c3b-7620-47f3-8c45-dac7867a3000 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:37.475336 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-aa503c3b-7620-47f3-8c45-dac7867a3000 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:37.476120 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-aa503c3b-7620-47f3-8c45-dac7867a3000 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:37.476555 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-aa503c3b-7620-47f3-8c45-dac7867a3000 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:37.490043 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.wsgi [None req-aa503c3b-7620-47f3-8c45-dac7867a3000 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] HTTP exception thrown: Instance 9e1bd9c3-d567-4517-8761-d154223724ce could not be found. Feb 16 14:32:37.492100 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-aa503c3b-7620-47f3-8c45-dac7867a3000 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Returning 404 to user: Instance 9e1bd9c3-d567-4517-8761-d154223724ce could not be found. {{(pid=117031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:32:37.492100 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-aa503c3b-7620-47f3-8c45-dac7867a3000 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "DELETE /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce" status: 404 len: 111 microversion: 2.1 time: 0.027651 Feb 16 14:32:37.492100 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 535/1009] 10.222.0.110 () {58 vars in 1243 bytes} [Wed Feb 16 14:32:37 2022] DELETE /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 14:32:37.500533 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b03b9e93-c2c6-49bb-a3d2-3407ae7f9634 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:37.501152 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b03b9e93-c2c6-49bb-a3d2-3407ae7f9634 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 9e1bd9c3-d567-4517-8761-d154223724ce] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:37.507083 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b03b9e93-c2c6-49bb-a3d2-3407ae7f9634 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:37.507541 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b03b9e93-c2c6-49bb-a3d2-3407ae7f9634 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:37.508327 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b03b9e93-c2c6-49bb-a3d2-3407ae7f9634 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:37.508776 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b03b9e93-c2c6-49bb-a3d2-3407ae7f9634 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:37.522183 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-b03b9e93-c2c6-49bb-a3d2-3407ae7f9634 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] HTTP exception thrown: Instance 9e1bd9c3-d567-4517-8761-d154223724ce could not be found. Feb 16 14:32:37.522812 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b03b9e93-c2c6-49bb-a3d2-3407ae7f9634 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Returning 404 to user: Instance 9e1bd9c3-d567-4517-8761-d154223724ce could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:32:37.523653 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b03b9e93-c2c6-49bb-a3d2-3407ae7f9634 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce" status: 404 len: 111 microversion: 2.1 time: 0.027018 Feb 16 14:32:37.524193 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 475/1010] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:32:37 2022] GET /compute/v2.1/servers/9e1bd9c3-d567-4517-8761-d154223724ce => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 14:32:37.682650 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-31b93eba-8573-423d-a4a6-8e6c5a5b0e23 req-1f758f34-92ca-42f6-b2da-f168ba8e747b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "542bf2d6-2c49-48e1-a903-3a14bcfb1b0d", "name": "network-vif-plugged", "status": "completed", "tag": "c35750d8-fe77-4744-8fd1-c9914d7c2435"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:32:37.684324 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:32:37.684324 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:32:37.691444 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-31b93eba-8573-423d-a4a6-8e6c5a5b0e23 req-1f758f34-92ca-42f6-b2da-f168ba8e747b service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:37.691897 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-31b93eba-8573-423d-a4a6-8e6c5a5b0e23 req-1f758f34-92ca-42f6-b2da-f168ba8e747b service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:37.704809 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-31b93eba-8573-423d-a4a6-8e6c5a5b0e23 req-1f758f34-92ca-42f6-b2da-f168ba8e747b service nova] Creating event network-vif-plugged:c35750d8-fe77-4744-8fd1-c9914d7c2435 for instance 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d on hv-cinder-80473 Feb 16 14:32:37.709792 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-31b93eba-8573-423d-a4a6-8e6c5a5b0e23 req-1f758f34-92ca-42f6-b2da-f168ba8e747b service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030797 Feb 16 14:32:37.710398 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 536/1011] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 14:32:37.745051 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6a46d4d4-4620-486b-9925-d91002830647 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:37.745678 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-6a46d4d4-4620-486b-9925-d91002830647 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:37.752547 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6a46d4d4-4620-486b-9925-d91002830647 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:37.756740 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6a46d4d4-4620-486b-9925-d91002830647 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:37.756740 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6a46d4d4-4620-486b-9925-d91002830647 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:37.756740 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6a46d4d4-4620-486b-9925-d91002830647 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:37.916354 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6a46d4d4-4620-486b-9925-d91002830647 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:37.924833 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6a46d4d4-4620-486b-9925-d91002830647 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:37.926358 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6a46d4d4-4620-486b-9925-d91002830647 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:37.927613 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-6a46d4d4-4620-486b-9925-d91002830647 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1730 microversion: 2.20 time: 0.186375 Feb 16 14:32:37.928175 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 476/1012] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:32:37 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1730 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:32:38.773653 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-ef08b6b2-4784-43ce-872f-cbca8148e967 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:38.774242 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-ef08b6b2-4784-43ce-872f-cbca8148e967 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:38.780940 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ef08b6b2-4784-43ce-872f-cbca8148e967 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:38.781395 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ef08b6b2-4784-43ce-872f-cbca8148e967 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:38.782176 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ef08b6b2-4784-43ce-872f-cbca8148e967 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:38.782615 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ef08b6b2-4784-43ce-872f-cbca8148e967 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:38.796206 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.wsgi [None req-ef08b6b2-4784-43ce-872f-cbca8148e967 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] HTTP exception thrown: Instance 64a4628d-ace6-4282-948c-d3e154ba9f35 could not be found. Feb 16 14:32:38.796802 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-ef08b6b2-4784-43ce-872f-cbca8148e967 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Returning 404 to user: Instance 64a4628d-ace6-4282-948c-d3e154ba9f35 could not be found. {{(pid=117031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:32:38.797657 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-ef08b6b2-4784-43ce-872f-cbca8148e967 tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "DELETE /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 404 len: 111 microversion: 2.1 time: 0.028543 Feb 16 14:32:38.798194 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 537/1013] 10.222.0.110 () {58 vars in 1243 bytes} [Wed Feb 16 14:32:38 2022] DELETE /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 14:32:38.806226 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-da542a89-0712-4462-bb4c-a7c8989373ac tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:38.806957 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-da542a89-0712-4462-bb4c-a7c8989373ac tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] [instance: 64a4628d-ace6-4282-948c-d3e154ba9f35] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:38.813491 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-da542a89-0712-4462-bb4c-a7c8989373ac tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:38.814032 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-da542a89-0712-4462-bb4c-a7c8989373ac tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:38.815051 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-da542a89-0712-4462-bb4c-a7c8989373ac tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:38.815559 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-da542a89-0712-4462-bb4c-a7c8989373ac tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:38.829077 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-da542a89-0712-4462-bb4c-a7c8989373ac tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] HTTP exception thrown: Instance 64a4628d-ace6-4282-948c-d3e154ba9f35 could not be found. Feb 16 14:32:38.829719 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-da542a89-0712-4462-bb4c-a7c8989373ac tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] Returning 404 to user: Instance 64a4628d-ace6-4282-948c-d3e154ba9f35 could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:32:38.830550 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-da542a89-0712-4462-bb4c-a7c8989373ac tempest-AttachVolumeTestJSON-881945302 tempest-AttachVolumeTestJSON-881945302-project] 10.222.0.110 "GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35" status: 404 len: 111 microversion: 2.1 time: 0.028141 Feb 16 14:32:38.831128 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 477/1014] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:32:38 2022] GET /compute/v2.1/servers/64a4628d-ace6-4282-948c-d3e154ba9f35 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 14:32:38.946357 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-fe194260-d185-42ae-9379-b8d902af6ea8 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:38.946994 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-fe194260-d185-42ae-9379-b8d902af6ea8 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:38.953590 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-fe194260-d185-42ae-9379-b8d902af6ea8 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:38.954255 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-fe194260-d185-42ae-9379-b8d902af6ea8 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:38.955081 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-fe194260-d185-42ae-9379-b8d902af6ea8 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:38.955522 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-fe194260-d185-42ae-9379-b8d902af6ea8 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:39.246833 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-fe194260-d185-42ae-9379-b8d902af6ea8 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:39.254936 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-fe194260-d185-42ae-9379-b8d902af6ea8 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:39.260157 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-fe194260-d185-42ae-9379-b8d902af6ea8 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:39.260157 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-fe194260-d185-42ae-9379-b8d902af6ea8 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1730 microversion: 2.20 time: 0.315682 Feb 16 14:32:39.260157 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 538/1015] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:32:38 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1730 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:32:40.277017 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-0312623a-797b-4487-83cd-423c4d50a264 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:40.277530 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-0312623a-797b-4487-83cd-423c4d50a264 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:40.283849 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0312623a-797b-4487-83cd-423c4d50a264 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:40.284309 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0312623a-797b-4487-83cd-423c4d50a264 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:40.285110 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0312623a-797b-4487-83cd-423c4d50a264 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:40.285553 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0312623a-797b-4487-83cd-423c4d50a264 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:40.431487 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-0312623a-797b-4487-83cd-423c4d50a264 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:40.445943 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-0312623a-797b-4487-83cd-423c4d50a264 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:40.447528 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-0312623a-797b-4487-83cd-423c4d50a264 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:40.453212 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-0312623a-797b-4487-83cd-423c4d50a264 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1730 microversion: 2.20 time: 0.180555 Feb 16 14:32:40.462171 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 478/1016] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:32:40 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:32:41.472262 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-f5fb5078-ee27-40ef-a709-5e9cf4af0fcc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:41.473053 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-f5fb5078-ee27-40ef-a709-5e9cf4af0fcc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:41.480540 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f5fb5078-ee27-40ef-a709-5e9cf4af0fcc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:41.480988 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f5fb5078-ee27-40ef-a709-5e9cf4af0fcc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:41.481824 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f5fb5078-ee27-40ef-a709-5e9cf4af0fcc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:41.482258 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f5fb5078-ee27-40ef-a709-5e9cf4af0fcc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:41.651558 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-f5fb5078-ee27-40ef-a709-5e9cf4af0fcc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:41.659295 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-f5fb5078-ee27-40ef-a709-5e9cf4af0fcc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:41.660815 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-f5fb5078-ee27-40ef-a709-5e9cf4af0fcc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:41.661991 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-f5fb5078-ee27-40ef-a709-5e9cf4af0fcc tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1717 microversion: 2.20 time: 0.193781 Feb 16 14:32:41.662545 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 539/1017] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:32:41 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1717 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:32:44.938933 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c247ef68-e2fc-4088-ae97-7e944603c989 tempest-VolumesNegativeTest-134652833 tempest-VolumesNegativeTest-134652833-project] Action: 'create', calling method: .version_select at 0x7f2990fdd790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1241887845", "metadata": {"Type": "work"}}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:32:44.940536 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c247ef68-e2fc-4088-ae97-7e944603c989 tempest-VolumesNegativeTest-134652833 tempest-VolumesNegativeTest-134652833-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:32:44.941347 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c247ef68-e2fc-4088-ae97-7e944603c989 tempest-VolumesNegativeTest-134652833 tempest-VolumesNegativeTest-134652833-project] 10.222.0.110 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.113693 Feb 16 14:32:44.941983 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 479/1018] 10.222.0.110 () {60 vars in 1160 bytes} [Wed Feb 16 14:32:44 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Feb 16 14:32:44.951954 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-0897d989-2718-4840-a309-6bfc13ac4495 tempest-VolumesNegativeTest-134652833 tempest-VolumesNegativeTest-134652833-project] Action: 'create', calling method: .version_select at 0x7f2990e670d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1951084117", "metadata": {"Type": "work"}}} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:32:44.953511 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-0897d989-2718-4840-a309-6bfc13ac4495 tempest-VolumesNegativeTest-134652833 tempest-VolumesNegativeTest-134652833-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:32:44.954315 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-0897d989-2718-4840-a309-6bfc13ac4495 tempest-VolumesNegativeTest-134652833 tempest-VolumesNegativeTest-134652833-project] 10.222.0.110 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.007091 Feb 16 14:32:44.954833 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 540/1019] 10.222.0.110 () {60 vars in 1160 bytes} [Wed Feb 16 14:32:44 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 16 14:32:44.963006 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-3c574122-9fce-4c77-a72c-7913fabc14b5 tempest-VolumesNegativeTest-134652833 tempest-VolumesNegativeTest-134652833-project] Action: 'create', calling method: .version_select at 0x7f2990e76a60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2090167208", "metadata": {"Type": "work"}}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:32:44.964696 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-3c574122-9fce-4c77-a72c-7913fabc14b5 tempest-VolumesNegativeTest-134652833 tempest-VolumesNegativeTest-134652833-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:32:44.965487 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-3c574122-9fce-4c77-a72c-7913fabc14b5 tempest-VolumesNegativeTest-134652833 tempest-VolumesNegativeTest-134652833-project] 10.222.0.110 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006046 Feb 16 14:32:44.965991 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 480/1020] 10.222.0.110 () {60 vars in 1160 bytes} [Wed Feb 16 14:32:44 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Feb 16 14:32:44.973676 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-7b89f35d-c0a7-4dde-a546-31300a9ce8c7 tempest-VolumesNegativeTest-134652833 tempest-VolumesNegativeTest-134652833-project] Calling method '.version_select at 0x7f2990f25820>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:45.001147 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.wsgi [None req-7b89f35d-c0a7-4dde-a546-31300a9ce8c7 tempest-VolumesNegativeTest-134652833 tempest-VolumesNegativeTest-134652833-project] HTTP exception thrown: Volume tempest-invalid-1231960292 could not be found. Feb 16 14:32:45.001736 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-7b89f35d-c0a7-4dde-a546-31300a9ce8c7 tempest-VolumesNegativeTest-134652833 tempest-VolumesNegativeTest-134652833-project] Returning 404 to user: Volume tempest-invalid-1231960292 could not be found. {{(pid=117031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:32:45.002541 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-7b89f35d-c0a7-4dde-a546-31300a9ce8c7 tempest-VolumesNegativeTest-134652833 tempest-VolumesNegativeTest-134652833-project] 10.222.0.110 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1231960292" status: 404 len: 99 microversion: 2.1 time: 0.032064 Feb 16 14:32:45.003874 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 541/1021] 10.222.0.110 () {58 vars in 1222 bytes} [Wed Feb 16 14:32:44 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1231960292 => generated 99 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Feb 16 14:32:45.013807 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-5185fa66-04c6-4307-8d1a-233027998338 tempest-VolumesNegativeTest-134652833 tempest-VolumesNegativeTest-134652833-project] 10.222.0.110 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004933 Feb 16 14:32:45.014319 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 481/1022] 10.222.0.110 () {58 vars in 1144 bytes} [Wed Feb 16 14:32:45 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 16 14:32:45.022471 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-e786494d-06e0-4470-9278-e4f502c5bc01 tempest-VolumesNegativeTest-134652833 tempest-VolumesNegativeTest-134652833-project] 10.222.0.110 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003555 Feb 16 14:32:45.022998 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 542/1023] 10.222.0.110 () {58 vars in 1141 bytes} [Wed Feb 16 14:32:45 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Feb 16 14:32:45.030635 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c3e695c6-5357-4d8d-b4d4-e1846987b618 tempest-VolumesNegativeTest-134652833 tempest-VolumesNegativeTest-134652833-project] Calling method '.version_select at 0x7f2990e76dc0>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:45.056282 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-c3e695c6-5357-4d8d-b4d4-e1846987b618 tempest-VolumesNegativeTest-134652833 tempest-VolumesNegativeTest-134652833-project] HTTP exception thrown: Volume 3aa38153-f4fa-4314-ac6f-ef0956b80e89 could not be found. Feb 16 14:32:45.056877 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c3e695c6-5357-4d8d-b4d4-e1846987b618 tempest-VolumesNegativeTest-134652833 tempest-VolumesNegativeTest-134652833-project] Returning 404 to user: Volume 3aa38153-f4fa-4314-ac6f-ef0956b80e89 could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:32:45.058202 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c3e695c6-5357-4d8d-b4d4-e1846987b618 tempest-VolumesNegativeTest-134652833 tempest-VolumesNegativeTest-134652833-project] 10.222.0.110 "DELETE /compute/v2.1/os-volumes/3aa38153-f4fa-4314-ac6f-ef0956b80e89" status: 404 len: 109 microversion: 2.1 time: 0.030451 Feb 16 14:32:45.058777 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 482/1024] 10.222.0.110 () {58 vars in 1252 bytes} [Wed Feb 16 14:32:45 2022] DELETE /compute/v2.1/os-volumes/3aa38153-f4fa-4314-ac6f-ef0956b80e89 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 14:32:45.067266 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-48a7d038-b1c1-4465-b9b6-bb9712d4ce9f tempest-VolumesNegativeTest-134652833 tempest-VolumesNegativeTest-134652833-project] Calling method '.version_select at 0x7f2990f70820>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:45.093389 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.wsgi [None req-48a7d038-b1c1-4465-b9b6-bb9712d4ce9f tempest-VolumesNegativeTest-134652833 tempest-VolumesNegativeTest-134652833-project] HTTP exception thrown: Volume ca6e6113-5191-4393-8cb9-3523d8cd3eba could not be found. Feb 16 14:32:45.093980 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-48a7d038-b1c1-4465-b9b6-bb9712d4ce9f tempest-VolumesNegativeTest-134652833 tempest-VolumesNegativeTest-134652833-project] Returning 404 to user: Volume ca6e6113-5191-4393-8cb9-3523d8cd3eba could not be found. {{(pid=117031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:32:45.094823 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-48a7d038-b1c1-4465-b9b6-bb9712d4ce9f tempest-VolumesNegativeTest-134652833 tempest-VolumesNegativeTest-134652833-project] 10.222.0.110 "GET /compute/v2.1/os-volumes/ca6e6113-5191-4393-8cb9-3523d8cd3eba" status: 404 len: 109 microversion: 2.1 time: 0.031068 Feb 16 14:32:45.095358 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 543/1025] 10.222.0.110 () {58 vars in 1249 bytes} [Wed Feb 16 14:32:45 2022] GET /compute/v2.1/os-volumes/ca6e6113-5191-4393-8cb9-3523d8cd3eba => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 14:32:48.373206 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-306866ee-1ee5-4d7b-bc55-f26dcd6c123d tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1639953936"}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:32:48.373761 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-306866ee-1ee5-4d7b-bc55-f26dcd6c123d tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:48.385121 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-306866ee-1ee5-4d7b-bc55-f26dcd6c123d tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:48.388065 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-306866ee-1ee5-4d7b-bc55-f26dcd6c123d tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:48.388065 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-306866ee-1ee5-4d7b-bc55-f26dcd6c123d tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:48.388065 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-306866ee-1ee5-4d7b-bc55-f26dcd6c123d tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:48.636372 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.network.security_group_api [None req-306866ee-1ee5-4d7b-bc55-f26dcd6c123d tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Removing security group d404954e-d10b-4006-b940-7e909456897d from port 5ee4e35f-3743-4549-89fe-13d02ed7b538 Feb 16 14:32:49.183503 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-306866ee-1ee5-4d7b-bc55-f26dcd6c123d tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "POST /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde/action" status: 202 len: 0 microversion: 2.1 time: 0.814020 Feb 16 14:32:49.184411 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 483/1026] 10.222.0.110 () {60 vars in 1282 bytes} [Wed Feb 16 14:32:48 2022] POST /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde/action => generated 0 bytes in 816 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 14:32:49.193100 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-a3994c4f-6f60-44d9-a49e-0875988264f1 req-53674ec8-3b1f-4c67-be5e-d891ab1c4251 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6354a804-6aae-4208-8eb6-6b821ac0ecde", "tag": "5ee4e35f-3743-4549-89fe-13d02ed7b538"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:32:49.195287 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:32:49.195287 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:32:49.213529 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-a3994c4f-6f60-44d9-a49e-0875988264f1 req-53674ec8-3b1f-4c67-be5e-d891ab1c4251 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:49.216870 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-a3994c4f-6f60-44d9-a49e-0875988264f1 req-53674ec8-3b1f-4c67-be5e-d891ab1c4251 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:49.240350 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-a3994c4f-6f60-44d9-a49e-0875988264f1 req-53674ec8-3b1f-4c67-be5e-d891ab1c4251 service nova] Creating event network-changed:5ee4e35f-3743-4549-89fe-13d02ed7b538 for instance 6354a804-6aae-4208-8eb6-6b821ac0ecde on hv-cinder-80473 Feb 16 14:32:49.253502 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-a3994c4f-6f60-44d9-a49e-0875988264f1 req-53674ec8-3b1f-4c67-be5e-d891ab1c4251 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062117 Feb 16 14:32:49.257514 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 544/1027] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:32:50.862083 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-533f08ef-7a1c-4059-8377-54e94c4c1442 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:50.863192 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-533f08ef-7a1c-4059-8377-54e94c4c1442 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:50.873963 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-07c65980-19b5-4841-af98-78a9caa094b9 req-59a534ea-4fd7-4da7-88b1-51c3b60aa6be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6354a804-6aae-4208-8eb6-6b821ac0ecde", "tag": "5ee4e35f-3743-4549-89fe-13d02ed7b538"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:32:50.876079 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:32:50.876079 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:32:50.882300 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-533f08ef-7a1c-4059-8377-54e94c4c1442 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:50.886207 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-533f08ef-7a1c-4059-8377-54e94c4c1442 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:50.888897 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-07c65980-19b5-4841-af98-78a9caa094b9 req-59a534ea-4fd7-4da7-88b1-51c3b60aa6be service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:50.890134 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-533f08ef-7a1c-4059-8377-54e94c4c1442 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:50.891000 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-533f08ef-7a1c-4059-8377-54e94c4c1442 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:50.894341 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-07c65980-19b5-4841-af98-78a9caa094b9 req-59a534ea-4fd7-4da7-88b1-51c3b60aa6be service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:50.918296 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-07c65980-19b5-4841-af98-78a9caa094b9 req-59a534ea-4fd7-4da7-88b1-51c3b60aa6be service nova] Creating event network-changed:5ee4e35f-3743-4549-89fe-13d02ed7b538 for instance 6354a804-6aae-4208-8eb6-6b821ac0ecde on hv-cinder-80473 Feb 16 14:32:50.928243 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-07c65980-19b5-4841-af98-78a9caa094b9 req-59a534ea-4fd7-4da7-88b1-51c3b60aa6be service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059767 Feb 16 14:32:50.931132 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 545/1028] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:32:50.993386 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-533f08ef-7a1c-4059-8377-54e94c4c1442 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lazy-loading 'services' on Instance uuid 6354a804-6aae-4208-8eb6-6b821ac0ecde {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:32:51.249244 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-533f08ef-7a1c-4059-8377-54e94c4c1442 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "DELETE /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde/os-volume_attachments/1df89e3b-f043-4746-95a0-803f8de83ee0" status: 202 len: 0 microversion: 2.1 time: 0.391729 Feb 16 14:32:51.254280 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 484/1029] 10.222.0.110 () {58 vars in 1420 bytes} [Wed Feb 16 14:32:50 2022] DELETE /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde/os-volume_attachments/1df89e3b-f043-4746-95a0-803f8de83ee0 => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 14:32:51.262097 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-77ac1571-b2e7-4078-911e-2c6c4f72e70f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:51.263447 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-77ac1571-b2e7-4078-911e-2c6c4f72e70f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:51.276736 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-77ac1571-b2e7-4078-911e-2c6c4f72e70f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:51.277706 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-77ac1571-b2e7-4078-911e-2c6c4f72e70f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:51.279366 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-77ac1571-b2e7-4078-911e-2c6c4f72e70f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:51.280517 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-77ac1571-b2e7-4078-911e-2c6c4f72e70f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:51.324930 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-77ac1571-b2e7-4078-911e-2c6c4f72e70f tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069830 Feb 16 14:32:51.325789 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 546/1030] 10.222.0.110 () {58 vars in 1306 bytes} [Wed Feb 16 14:32:51 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 14:32:52.337445 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-59f93ae7-c4ee-4ca3-a780-768b1be9b3db tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:52.339201 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-59f93ae7-c4ee-4ca3-a780-768b1be9b3db tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:52.356798 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-59f93ae7-c4ee-4ca3-a780-768b1be9b3db tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:52.357394 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-59f93ae7-c4ee-4ca3-a780-768b1be9b3db tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:52.358180 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-59f93ae7-c4ee-4ca3-a780-768b1be9b3db tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:52.358859 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-59f93ae7-c4ee-4ca3-a780-768b1be9b3db tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:52.393536 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-59f93ae7-c4ee-4ca3-a780-768b1be9b3db tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056481 Feb 16 14:32:52.393536 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 485/1031] 10.222.0.110 () {58 vars in 1306 bytes} [Wed Feb 16 14:32:52 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:32:53.400067 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-083a9067-8287-4b6b-a342-506fb4336a45 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:53.400987 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-083a9067-8287-4b6b-a342-506fb4336a45 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:53.407930 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-083a9067-8287-4b6b-a342-506fb4336a45 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:53.408381 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-083a9067-8287-4b6b-a342-506fb4336a45 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:53.409173 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-083a9067-8287-4b6b-a342-506fb4336a45 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:53.409610 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-083a9067-8287-4b6b-a342-506fb4336a45 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:53.439128 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-083a9067-8287-4b6b-a342-506fb4336a45 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042748 Feb 16 14:32:53.439707 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 547/1032] 10.222.0.110 () {58 vars in 1306 bytes} [Wed Feb 16 14:32:53 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Feb 16 14:32:53.450148 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-dbdcf04e-64b1-4d1a-b4f3-52d8a79324c6 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:53.450781 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-dbdcf04e-64b1-4d1a-b4f3-52d8a79324c6 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:53.457237 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dbdcf04e-64b1-4d1a-b4f3-52d8a79324c6 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:53.457692 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dbdcf04e-64b1-4d1a-b4f3-52d8a79324c6 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:53.458484 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dbdcf04e-64b1-4d1a-b4f3-52d8a79324c6 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:53.458961 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dbdcf04e-64b1-4d1a-b4f3-52d8a79324c6 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:53.533791 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-dbdcf04e-64b1-4d1a-b4f3-52d8a79324c6 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] HTTP exception thrown: Instance 6354a804-6aae-4208-8eb6-6b821ac0ecde is not attached to volume 1df89e3b-f043-4746-95a0-803f8de83ee0 Feb 16 14:32:53.534429 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-dbdcf04e-64b1-4d1a-b4f3-52d8a79324c6 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Returning 404 to user: Instance 6354a804-6aae-4208-8eb6-6b821ac0ecde is not attached to volume 1df89e3b-f043-4746-95a0-803f8de83ee0 {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:32:53.536611 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-dbdcf04e-64b1-4d1a-b4f3-52d8a79324c6 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "DELETE /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde/os-volume_attachments/1df89e3b-f043-4746-95a0-803f8de83ee0" status: 404 len: 154 microversion: 2.1 time: 0.089724 Feb 16 14:32:53.536611 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 486/1033] 10.222.0.110 () {58 vars in 1420 bytes} [Wed Feb 16 14:32:53 2022] DELETE /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde/os-volume_attachments/1df89e3b-f043-4746-95a0-803f8de83ee0 => generated 154 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 14:32:54.770165 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-1748a4c2-7c24-4efa-b46a-45c4f04cfb48 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:54.770871 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-1748a4c2-7c24-4efa-b46a-45c4f04cfb48 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:54.777517 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1748a4c2-7c24-4efa-b46a-45c4f04cfb48 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:54.778035 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1748a4c2-7c24-4efa-b46a-45c4f04cfb48 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:54.795420 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1748a4c2-7c24-4efa-b46a-45c4f04cfb48 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:54.795420 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1748a4c2-7c24-4efa-b46a-45c4f04cfb48 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:54.804479 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-1748a4c2-7c24-4efa-b46a-45c4f04cfb48 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Going to try to terminate instance {{(pid=117031) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 16 14:32:55.000725 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-1748a4c2-7c24-4efa-b46a-45c4f04cfb48 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "DELETE /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 204 len: 0 microversion: 2.1 time: 0.233682 Feb 16 14:32:55.001637 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 548/1034] 10.222.0.110 () {58 vars in 1243 bytes} [Wed Feb 16 14:32:54 2022] DELETE /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 16 14:32:55.010004 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-983bcb5b-d206-4864-a29c-374204f45110 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:55.011387 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-983bcb5b-d206-4864-a29c-374204f45110 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:55.017733 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-983bcb5b-d206-4864-a29c-374204f45110 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:55.018188 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-983bcb5b-d206-4864-a29c-374204f45110 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:55.019010 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-983bcb5b-d206-4864-a29c-374204f45110 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:55.019458 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-983bcb5b-d206-4864-a29c-374204f45110 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:55.158381 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-983bcb5b-d206-4864-a29c-374204f45110 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:55.165825 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-983bcb5b-d206-4864-a29c-374204f45110 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1557 microversion: 2.1 time: 0.159813 Feb 16 14:32:55.166394 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 487/1035] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:32:55 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1557 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:32:56.183781 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-cd7a4070-a263-4e5f-a1c1-b74721ff0509 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:56.184515 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-cd7a4070-a263-4e5f-a1c1-b74721ff0509 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:56.191210 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-cd7a4070-a263-4e5f-a1c1-b74721ff0509 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:56.191668 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-cd7a4070-a263-4e5f-a1c1-b74721ff0509 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:56.192452 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-cd7a4070-a263-4e5f-a1c1-b74721ff0509 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:56.192884 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-cd7a4070-a263-4e5f-a1c1-b74721ff0509 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:56.332742 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-cd7a4070-a263-4e5f-a1c1-b74721ff0509 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:56.340213 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-cd7a4070-a263-4e5f-a1c1-b74721ff0509 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1557 microversion: 2.1 time: 0.161353 Feb 16 14:32:56.345328 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 549/1036] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:32:56 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:32:57.357693 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-5d9d39e0-6ea0-4d07-97f0-ca0570f3bf78 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:57.358279 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-5d9d39e0-6ea0-4d07-97f0-ca0570f3bf78 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:57.364682 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5d9d39e0-6ea0-4d07-97f0-ca0570f3bf78 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:57.365141 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5d9d39e0-6ea0-4d07-97f0-ca0570f3bf78 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:57.365934 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5d9d39e0-6ea0-4d07-97f0-ca0570f3bf78 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:57.366376 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5d9d39e0-6ea0-4d07-97f0-ca0570f3bf78 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:57.622756 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-5d9d39e0-6ea0-4d07-97f0-ca0570f3bf78 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:57.630428 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-5d9d39e0-6ea0-4d07-97f0-ca0570f3bf78 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1557 microversion: 2.1 time: 0.277110 Feb 16 14:32:57.631116 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 488/1037] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:32:57 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1557 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:32:57.828194 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-1a41c7ac-12f0-4ca6-b159-fa9e488eb304 req-f97869ad-fb69-4d9d-95b0-0dca15405590 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6354a804-6aae-4208-8eb6-6b821ac0ecde", "name": "network-vif-deleted", "tag": "5ee4e35f-3743-4549-89fe-13d02ed7b538"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:32:57.830297 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:32:57.830297 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:32:57.848569 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-1a41c7ac-12f0-4ca6-b159-fa9e488eb304 req-f97869ad-fb69-4d9d-95b0-0dca15405590 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:57.849090 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-1a41c7ac-12f0-4ca6-b159-fa9e488eb304 req-f97869ad-fb69-4d9d-95b0-0dca15405590 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:57.860618 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-1a41c7ac-12f0-4ca6-b159-fa9e488eb304 req-f97869ad-fb69-4d9d-95b0-0dca15405590 service nova] Creating event network-vif-deleted:5ee4e35f-3743-4549-89fe-13d02ed7b538 for instance 6354a804-6aae-4208-8eb6-6b821ac0ecde on hv-cinder-80473 Feb 16 14:32:57.865481 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-1a41c7ac-12f0-4ca6-b159-fa9e488eb304 req-f97869ad-fb69-4d9d-95b0-0dca15405590 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041358 Feb 16 14:32:57.866234 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 550/1038] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:32:58.657950 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e8763dec-d3fc-43ab-b2e0-98ef5c1b2973 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:58.657950 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-e8763dec-d3fc-43ab-b2e0-98ef5c1b2973 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:58.657950 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e8763dec-d3fc-43ab-b2e0-98ef5c1b2973 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:58.657950 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e8763dec-d3fc-43ab-b2e0-98ef5c1b2973 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:58.658687 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e8763dec-d3fc-43ab-b2e0-98ef5c1b2973 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:58.658687 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e8763dec-d3fc-43ab-b2e0-98ef5c1b2973 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:58.690955 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e8763dec-d3fc-43ab-b2e0-98ef5c1b2973 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:58.691416 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e8763dec-d3fc-43ab-b2e0-98ef5c1b2973 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:58.691876 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-e8763dec-d3fc-43ab-b2e0-98ef5c1b2973 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lazy-loading 'fault' on Instance uuid 6354a804-6aae-4208-8eb6-6b821ac0ecde {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:32:58.738657 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-e8763dec-d3fc-43ab-b2e0-98ef5c1b2973 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4876916bb0948a6ada6c5202a01d466', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65654470458446859230c6803abfa3ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:32:58.748895 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-e8763dec-d3fc-43ab-b2e0-98ef5c1b2973 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 200 len: 1352 microversion: 2.1 time: 0.105210 Feb 16 14:32:58.749562 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 489/1039] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:32:58 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 1352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:32:59.766823 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-77760f33-e613-4ba1-8bca-bb7239096344 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:59.767450 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-77760f33-e613-4ba1-8bca-bb7239096344 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] [instance: 6354a804-6aae-4208-8eb6-6b821ac0ecde] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:32:59.773473 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-77760f33-e613-4ba1-8bca-bb7239096344 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:59.773925 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-77760f33-e613-4ba1-8bca-bb7239096344 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:59.774736 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-77760f33-e613-4ba1-8bca-bb7239096344 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:32:59.775177 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-77760f33-e613-4ba1-8bca-bb7239096344 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:32:59.789183 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.wsgi [None req-77760f33-e613-4ba1-8bca-bb7239096344 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] HTTP exception thrown: Instance 6354a804-6aae-4208-8eb6-6b821ac0ecde could not be found. Feb 16 14:32:59.789781 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-77760f33-e613-4ba1-8bca-bb7239096344 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Returning 404 to user: Instance 6354a804-6aae-4208-8eb6-6b821ac0ecde could not be found. {{(pid=117031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:32:59.790599 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-77760f33-e613-4ba1-8bca-bb7239096344 tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde" status: 404 len: 111 microversion: 2.1 time: 0.028453 Feb 16 14:32:59.791292 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 551/1040] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:32:59 2022] GET /compute/v2.1/servers/6354a804-6aae-4208-8eb6-6b821ac0ecde => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 14:32:59.801042 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-5e8bdf12-39b9-4642-a92f-cae6a3471e2b tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] Calling method '.version_select at 0x7f2990fe15e0>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:32:59.881388 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-5e8bdf12-39b9-4642-a92f-cae6a3471e2b tempest-TestMinimumBasicScenario-1779347449 tempest-TestMinimumBasicScenario-1779347449-project] 10.222.0.110 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2072384014" status: 202 len: 0 microversion: 2.1 time: 0.084898 Feb 16 14:32:59.881973 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 490/1041] 10.222.0.110 () {58 vars in 1276 bytes} [Wed Feb 16 14:32:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2072384014 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 14:33:19.796635 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-0aa5036c-9270-47a5-89b9-324434107bd8 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Action: 'create', calling method: .version_select at 0x7f2990dfb940>, body: {"keypair": {"name": "tempest-TestShelveInstance-617354267"}} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:33:19.818839 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.quota [None req-0aa5036c-9270-47a5-89b9-324434107bd8 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Getting quotas for project b87af7cf2ef041d795d4b0f320e7b3b0. Resources: {'key_pairs'} {{(pid=117031) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 14:33:19.824789 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.quota [None req-0aa5036c-9270-47a5-89b9-324434107bd8 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Getting quotas for user bb544a38285c485ba51e44991d1c4be2 and project b87af7cf2ef041d795d4b0f320e7b3b0. Resources: {'key_pairs'} {{(pid=117031) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 14:33:20.026064 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-15f6448c-d475-4786-83b5-06234fd38a78 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:33:20.027030 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-15f6448c-d475-4786-83b5-06234fd38a78 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:33:20.035608 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-15f6448c-d475-4786-83b5-06234fd38a78 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:20.036073 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-15f6448c-d475-4786-83b5-06234fd38a78 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:20.036881 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-15f6448c-d475-4786-83b5-06234fd38a78 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:20.037327 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-15f6448c-d475-4786-83b5-06234fd38a78 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:20.060423 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.quota [None req-0aa5036c-9270-47a5-89b9-324434107bd8 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Getting quotas for project b87af7cf2ef041d795d4b0f320e7b3b0. Resources: {'key_pairs'} {{(pid=117031) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 14:33:20.065366 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.quota [None req-0aa5036c-9270-47a5-89b9-324434107bd8 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Getting quotas for user bb544a38285c485ba51e44991d1c4be2 and project b87af7cf2ef041d795d4b0f320e7b3b0. Resources: {'key_pairs'} {{(pid=117031) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 14:33:20.070390 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-15f6448c-d475-4786-83b5-06234fd38a78 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050438 Feb 16 14:33:20.070994 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 491/1042] 10.222.0.110 () {60 vars in 1347 bytes} [Wed Feb 16 14:33:20 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:33:20.081295 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-0aa5036c-9270-47a5-89b9-324434107bd8 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.474855 Feb 16 14:33:20.081761 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 552/1043] 10.222.0.110 () {60 vars in 1162 bytes} [Wed Feb 16 14:33:19 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:33:20.154166 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-4fbac316-66e7-4b25-9cea-d61a87b4e9aa tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:33:20.154743 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-4fbac316-66e7-4b25-9cea-d61a87b4e9aa tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:33:20.163131 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4fbac316-66e7-4b25-9cea-d61a87b4e9aa tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:20.163588 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4fbac316-66e7-4b25-9cea-d61a87b4e9aa tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:20.164403 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4fbac316-66e7-4b25-9cea-d61a87b4e9aa tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:20.164844 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-4fbac316-66e7-4b25-9cea-d61a87b4e9aa tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:20.199573 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-4fbac316-66e7-4b25-9cea-d61a87b4e9aa tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Going to try to terminate instance {{(pid=117032) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 16 14:33:20.615006 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-4fbac316-66e7-4b25-9cea-d61a87b4e9aa tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "DELETE /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 204 len: 0 microversion: 2.20 time: 0.464890 Feb 16 14:33:20.615939 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 492/1044] 10.222.0.110 () {60 vars in 1284 bytes} [Wed Feb 16 14:33:20 2022] DELETE /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 16 14:33:20.624434 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-3004e676-e13e-44ba-b594-d9723bb90585 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:33:20.625044 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-3004e676-e13e-44ba-b594-d9723bb90585 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:33:20.631531 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3004e676-e13e-44ba-b594-d9723bb90585 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:20.631978 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3004e676-e13e-44ba-b594-d9723bb90585 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:20.632780 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3004e676-e13e-44ba-b594-d9723bb90585 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:20.633214 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3004e676-e13e-44ba-b594-d9723bb90585 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:20.811526 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-3004e676-e13e-44ba-b594-d9723bb90585 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:33:20.828133 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-3004e676-e13e-44ba-b594-d9723bb90585 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:33:20.831083 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-3004e676-e13e-44ba-b594-d9723bb90585 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:33:20.833289 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-3004e676-e13e-44ba-b594-d9723bb90585 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1723 microversion: 2.20 time: 0.212779 Feb 16 14:33:20.834318 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 553/1045] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:33:20 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:33:21.861889 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b21e0c99-5058-4f60-ad8e-5ed205f2d7a0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:33:21.862736 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b21e0c99-5058-4f60-ad8e-5ed205f2d7a0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:33:21.869910 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b21e0c99-5058-4f60-ad8e-5ed205f2d7a0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:21.870442 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b21e0c99-5058-4f60-ad8e-5ed205f2d7a0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:21.871405 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b21e0c99-5058-4f60-ad8e-5ed205f2d7a0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:21.871890 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b21e0c99-5058-4f60-ad8e-5ed205f2d7a0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:22.024234 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b21e0c99-5058-4f60-ad8e-5ed205f2d7a0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:33:22.034380 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b21e0c99-5058-4f60-ad8e-5ed205f2d7a0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:33:22.036812 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b21e0c99-5058-4f60-ad8e-5ed205f2d7a0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:33:22.039359 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b21e0c99-5058-4f60-ad8e-5ed205f2d7a0 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1723 microversion: 2.20 time: 0.180563 Feb 16 14:33:22.052940 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 493/1046] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:33:21 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:33:23.059271 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-c733bdbd-6e57-48fa-828f-945521d58fd4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:33:23.060727 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-c733bdbd-6e57-48fa-828f-945521d58fd4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:33:23.067164 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c733bdbd-6e57-48fa-828f-945521d58fd4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:23.067616 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c733bdbd-6e57-48fa-828f-945521d58fd4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:23.068490 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c733bdbd-6e57-48fa-828f-945521d58fd4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:23.069546 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c733bdbd-6e57-48fa-828f-945521d58fd4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:23.138177 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-c733bdbd-6e57-48fa-828f-945521d58fd4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:33:23.149597 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-c733bdbd-6e57-48fa-828f-945521d58fd4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:33:23.153806 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-c733bdbd-6e57-48fa-828f-945521d58fd4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '745ca4a19a674037b9fee7f3778c05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeb2105b246e4f78bccf81a39b007f69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:33:23.155058 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-c733bdbd-6e57-48fa-828f-945521d58fd4 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 200 len: 1656 microversion: 2.20 time: 0.100154 Feb 16 14:33:23.156113 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 554/1047] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:33:23 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 1656 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Feb 16 14:33:23.264582 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-b4945f37-b617-4827-89ed-368a845b6196 req-e9286812-ba37-4c78-9fec-d930abceb92e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "542bf2d6-2c49-48e1-a903-3a14bcfb1b0d", "name": "network-vif-deleted", "tag": "c35750d8-fe77-4744-8fd1-c9914d7c2435"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:33:23.266058 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:33:23.266058 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: warnings.warn(msg) Feb 16 14:33:23.273873 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-b4945f37-b617-4827-89ed-368a845b6196 req-e9286812-ba37-4c78-9fec-d930abceb92e service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:23.274452 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-b4945f37-b617-4827-89ed-368a845b6196 req-e9286812-ba37-4c78-9fec-d930abceb92e service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:23.292757 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-b4945f37-b617-4827-89ed-368a845b6196 req-e9286812-ba37-4c78-9fec-d930abceb92e service nova] Creating event network-vif-deleted:c35750d8-fe77-4744-8fd1-c9914d7c2435 for instance 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d on hv-cinder-80473 Feb 16 14:33:23.300044 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-b4945f37-b617-4827-89ed-368a845b6196 req-e9286812-ba37-4c78-9fec-d930abceb92e service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039098 Feb 16 14:33:23.300651 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 494/1048] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:33:24.173382 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-924a1b97-27af-4902-9057-cfb7dfef8de3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:33:24.174093 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-924a1b97-27af-4902-9057-cfb7dfef8de3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:33:24.180598 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-924a1b97-27af-4902-9057-cfb7dfef8de3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:24.187541 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-924a1b97-27af-4902-9057-cfb7dfef8de3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:24.187541 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-924a1b97-27af-4902-9057-cfb7dfef8de3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:24.187541 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-924a1b97-27af-4902-9057-cfb7dfef8de3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:24.198987 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.wsgi [None req-924a1b97-27af-4902-9057-cfb7dfef8de3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] HTTP exception thrown: Instance 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d could not be found. Feb 16 14:33:24.199742 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-924a1b97-27af-4902-9057-cfb7dfef8de3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Returning 404 to user: Instance 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d could not be found. {{(pid=117031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:33:24.201022 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-924a1b97-27af-4902-9057-cfb7dfef8de3 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 404 len: 111 microversion: 2.20 time: 0.031176 Feb 16 14:33:24.201589 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 555/1049] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:33:24 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 16 14:33:24.211983 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-07da44af-9610-48b9-8a37-04302a41531f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '.version_select at 0x7f2990f75ca0>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:33:24.286987 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-07da44af-9610-48b9-8a37-04302a41531f tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-941938357" status: 204 len: 0 microversion: 2.20 time: 0.080044 Feb 16 14:33:24.288639 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 495/1050] 10.222.0.110 () {60 vars in 1263 bytes} [Wed Feb 16 14:33:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-941938357 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Feb 16 14:33:26.419265 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-49f1bcdc-1ba9-48ce-8953-f55a7962df17 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:33:26.419739 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-49f1bcdc-1ba9-48ce-8953-f55a7962df17 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:33:26.426026 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-49f1bcdc-1ba9-48ce-8953-f55a7962df17 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:26.426470 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-49f1bcdc-1ba9-48ce-8953-f55a7962df17 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:26.427271 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-49f1bcdc-1ba9-48ce-8953-f55a7962df17 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:26.427697 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-49f1bcdc-1ba9-48ce-8953-f55a7962df17 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:26.442971 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.wsgi [None req-49f1bcdc-1ba9-48ce-8953-f55a7962df17 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] HTTP exception thrown: Instance 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d could not be found. Feb 16 14:33:26.443644 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-49f1bcdc-1ba9-48ce-8953-f55a7962df17 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Returning 404 to user: Instance 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d could not be found. {{(pid=117031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:33:26.444613 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-49f1bcdc-1ba9-48ce-8953-f55a7962df17 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "DELETE /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 404 len: 111 microversion: 2.20 time: 0.029592 Feb 16 14:33:26.445392 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 556/1051] 10.222.0.110 () {60 vars in 1284 bytes} [Wed Feb 16 14:33:26 2022] DELETE /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 16 14:33:26.458019 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-babea569-76d5-498c-9526-297b61e86f5e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:33:26.459016 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-babea569-76d5-498c-9526-297b61e86f5e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:33:26.467699 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-babea569-76d5-498c-9526-297b61e86f5e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:26.468149 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-babea569-76d5-498c-9526-297b61e86f5e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:26.468979 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-babea569-76d5-498c-9526-297b61e86f5e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:26.469426 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-babea569-76d5-498c-9526-297b61e86f5e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:26.484207 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-babea569-76d5-498c-9526-297b61e86f5e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] HTTP exception thrown: Instance 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d could not be found. Feb 16 14:33:26.487946 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-babea569-76d5-498c-9526-297b61e86f5e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Returning 404 to user: Instance 542bf2d6-2c49-48e1-a903-3a14bcfb1b0d could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:33:26.487946 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-babea569-76d5-498c-9526-297b61e86f5e tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d" status: 404 len: 111 microversion: 2.20 time: 0.031600 Feb 16 14:33:26.487946 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 496/1052] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:33:26 2022] GET /compute/v2.1/servers/542bf2d6-2c49-48e1-a903-3a14bcfb1b0d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 16 14:33:27.739689 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-a8f05f68-dbe9-4c33-935e-002029e2a383 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:33:27.740169 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-a8f05f68-dbe9-4c33-935e-002029e2a383 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:33:27.747292 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a8f05f68-dbe9-4c33-935e-002029e2a383 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:27.747683 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a8f05f68-dbe9-4c33-935e-002029e2a383 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:27.748479 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a8f05f68-dbe9-4c33-935e-002029e2a383 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:27.748914 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a8f05f68-dbe9-4c33-935e-002029e2a383 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:27.763552 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.wsgi [None req-a8f05f68-dbe9-4c33-935e-002029e2a383 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] HTTP exception thrown: Instance e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 could not be found. Feb 16 14:33:27.764153 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-a8f05f68-dbe9-4c33-935e-002029e2a383 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Returning 404 to user: Instance e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 could not be found. {{(pid=117031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:33:27.765013 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-a8f05f68-dbe9-4c33-935e-002029e2a383 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "DELETE /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 404 len: 111 microversion: 2.20 time: 0.029140 Feb 16 14:33:27.765574 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 557/1053] 10.222.0.110 () {60 vars in 1284 bytes} [Wed Feb 16 14:33:27 2022] DELETE /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 16 14:33:27.773416 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-94eb026d-2475-4d98-864c-3d0b951ec219 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:33:27.774037 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-94eb026d-2475-4d98-864c-3d0b951ec219 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] [instance: e2139817-3f2e-4e56-87d6-a56a2ca2f6f9] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:33:27.781403 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-94eb026d-2475-4d98-864c-3d0b951ec219 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:27.781868 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-94eb026d-2475-4d98-864c-3d0b951ec219 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:27.782704 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-94eb026d-2475-4d98-864c-3d0b951ec219 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:27.783158 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-94eb026d-2475-4d98-864c-3d0b951ec219 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:27.799787 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-94eb026d-2475-4d98-864c-3d0b951ec219 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] HTTP exception thrown: Instance e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 could not be found. Feb 16 14:33:27.800952 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-94eb026d-2475-4d98-864c-3d0b951ec219 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] Returning 404 to user: Instance e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:33:27.802163 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-94eb026d-2475-4d98-864c-3d0b951ec219 tempest-AttachVolumeShelveTestJSON-99062563 tempest-AttachVolumeShelveTestJSON-99062563-project] 10.222.0.110 "GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9" status: 404 len: 111 microversion: 2.20 time: 0.032430 Feb 16 14:33:27.802761 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 497/1054] 10.222.0.110 () {60 vars in 1281 bytes} [Wed Feb 16 14:33:27 2022] GET /compute/v2.1/servers/e2139817-3f2e-4e56-87d6-a56a2ca2f6f9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Feb 16 14:33:40.693475 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-684c5add-7ad7-4429-86ef-0c8ec8e12cdb tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1698710214", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-617354267", "security_groups": [{"name": "tempest-secgroup-smoke-304171873"}], "networks": [{"uuid": "7c5dc760-aa7b-446e-9cc3-aee781831e3d"}], "block_device_mapping_v2": [{"uuid": "8be35686-75ee-4d4a-9832-98986bb8b53c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:33:40.808779 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.network.neutron [None req-684c5add-7ad7-4429-86ef-0c8ec8e12cdb tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] validate_networks() for [('7c5dc760-aa7b-446e-9cc3-aee781831e3d', None, None, None, None, None)] {{(pid=117031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 16 14:33:41.173170 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-684c5add-7ad7-4429-86ef-0c8ec8e12cdb tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Flavor limits 0:0:0 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 16 14:33:41.173659 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-684c5add-7ad7-4429-86ef-0c8ec8e12cdb tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Image limits 0:0:0 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 16 14:33:41.174160 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-684c5add-7ad7-4429-86ef-0c8ec8e12cdb tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Flavor pref 0:0:0 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 16 14:33:41.174560 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-684c5add-7ad7-4429-86ef-0c8ec8e12cdb tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Image pref 0:0:0 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 16 14:33:41.175178 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-684c5add-7ad7-4429-86ef-0c8ec8e12cdb tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 16 14:33:41.184683 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-684c5add-7ad7-4429-86ef-0c8ec8e12cdb tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:41.185320 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-684c5add-7ad7-4429-86ef-0c8ec8e12cdb tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:41.186662 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-684c5add-7ad7-4429-86ef-0c8ec8e12cdb tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:41.187108 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-684c5add-7ad7-4429-86ef-0c8ec8e12cdb tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:41.206521 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.quota [None req-684c5add-7ad7-4429-86ef-0c8ec8e12cdb tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Getting quotas for project b87af7cf2ef041d795d4b0f320e7b3b0. Resources: {'cores', 'instances', 'ram'} {{(pid=117031) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 14:33:41.210555 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.quota [None req-684c5add-7ad7-4429-86ef-0c8ec8e12cdb tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Getting quotas for user bb544a38285c485ba51e44991d1c4be2 and project b87af7cf2ef041d795d4b0f320e7b3b0. Resources: {'cores', 'instances', 'ram'} {{(pid=117031) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 14:33:41.264152 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-684c5add-7ad7-4429-86ef-0c8ec8e12cdb tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Going to run 1 instances... {{(pid=117031) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 16 14:33:41.266968 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-684c5add-7ad7-4429-86ef-0c8ec8e12cdb tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8be35686-75ee-4d4a-9832-98986bb8b53c',volume_size=None,volume_type=None)] {{(pid=117031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 16 14:33:41.766769 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-684c5add-7ad7-4429-86ef-0c8ec8e12cdb tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.076971 Feb 16 14:33:41.775128 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 558/1055] 10.222.0.110 () {60 vars in 1151 bytes} [Wed Feb 16 14:33:40 2022] POST /compute/v2.1/servers => generated 407 bytes in 1079 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Feb 16 14:33:41.781855 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-41508696-c592-4d71-b7c5-70dc36881f93 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:33:41.783545 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-41508696-c592-4d71-b7c5-70dc36881f93 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:33:41.852201 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-41508696-c592-4d71-b7c5-70dc36881f93 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:33:41.859358 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-41508696-c592-4d71-b7c5-70dc36881f93 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1091 microversion: 2.1 time: 0.082452 Feb 16 14:33:41.860520 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 498/1056] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:33:41 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1091 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:33:42.876609 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-59f407d3-83e9-46e6-976c-beca23333c13 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:33:42.877219 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-59f407d3-83e9-46e6-976c-beca23333c13 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:33:42.883725 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-59f407d3-83e9-46e6-976c-beca23333c13 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:42.884176 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-59f407d3-83e9-46e6-976c-beca23333c13 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:42.884954 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-59f407d3-83e9-46e6-976c-beca23333c13 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:42.885401 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-59f407d3-83e9-46e6-976c-beca23333c13 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:42.950247 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-59f407d3-83e9-46e6-976c-beca23333c13 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:33:42.957938 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-59f407d3-83e9-46e6-976c-beca23333c13 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1141 microversion: 2.1 time: 0.085994 Feb 16 14:33:42.958507 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 559/1057] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:33:42 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1141 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:33:43.974282 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-3fc1fb81-6e3b-4ef0-ba45-abaa02fe9a12 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:33:43.974852 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-3fc1fb81-6e3b-4ef0-ba45-abaa02fe9a12 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:33:43.981977 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3fc1fb81-6e3b-4ef0-ba45-abaa02fe9a12 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:43.982429 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3fc1fb81-6e3b-4ef0-ba45-abaa02fe9a12 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:43.983377 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3fc1fb81-6e3b-4ef0-ba45-abaa02fe9a12 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:43.984013 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-3fc1fb81-6e3b-4ef0-ba45-abaa02fe9a12 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:44.046493 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-3fc1fb81-6e3b-4ef0-ba45-abaa02fe9a12 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:33:44.053911 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-3fc1fb81-6e3b-4ef0-ba45-abaa02fe9a12 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1189 microversion: 2.1 time: 0.083420 Feb 16 14:33:44.054804 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 499/1058] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:33:43 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1189 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:33:45.070968 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-fe775250-bb76-42a0-b557-6dc1169d5af2 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:33:45.071690 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-fe775250-bb76-42a0-b557-6dc1169d5af2 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:33:45.079817 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-fe775250-bb76-42a0-b557-6dc1169d5af2 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:45.080313 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-fe775250-bb76-42a0-b557-6dc1169d5af2 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:45.081114 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-fe775250-bb76-42a0-b557-6dc1169d5af2 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:45.081550 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-fe775250-bb76-42a0-b557-6dc1169d5af2 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:45.145676 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-fe775250-bb76-42a0-b557-6dc1169d5af2 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:33:45.153292 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-fe775250-bb76-42a0-b557-6dc1169d5af2 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1207 microversion: 2.1 time: 0.086022 Feb 16 14:33:45.153864 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 560/1059] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:33:45 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1207 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:33:46.170367 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-f2615cb9-cf69-4021-ac52-e5c8ef2e941e tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:33:46.171566 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-f2615cb9-cf69-4021-ac52-e5c8ef2e941e tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:33:46.177912 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f2615cb9-cf69-4021-ac52-e5c8ef2e941e tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:46.178365 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f2615cb9-cf69-4021-ac52-e5c8ef2e941e tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:46.179182 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f2615cb9-cf69-4021-ac52-e5c8ef2e941e tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:46.179626 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-f2615cb9-cf69-4021-ac52-e5c8ef2e941e tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:46.262688 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-10d9e1b6-5f6c-4eac-a4e7-9b35f30b3e17 req-185d50df-60ff-4e78-b23a-bcf3864374f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c27f46dc-b073-4643-aecd-9706f8a2bd6a", "tag": "ed3741ec-f06d-46ec-8c0b-7eba0140cb02"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:33:46.265969 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:33:46.265969 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:33:46.276459 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-10d9e1b6-5f6c-4eac-a4e7-9b35f30b3e17 req-185d50df-60ff-4e78-b23a-bcf3864374f4 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:46.280508 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-10d9e1b6-5f6c-4eac-a4e7-9b35f30b3e17 req-185d50df-60ff-4e78-b23a-bcf3864374f4 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:46.292567 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-10d9e1b6-5f6c-4eac-a4e7-9b35f30b3e17 req-185d50df-60ff-4e78-b23a-bcf3864374f4 service nova] Creating event network-changed:ed3741ec-f06d-46ec-8c0b-7eba0140cb02 for instance c27f46dc-b073-4643-aecd-9706f8a2bd6a on hv-cinder-80473 Feb 16 14:33:46.299865 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-10d9e1b6-5f6c-4eac-a4e7-9b35f30b3e17 req-185d50df-60ff-4e78-b23a-bcf3864374f4 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040980 Feb 16 14:33:46.300905 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 561/1060] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 14:33:46.415305 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-f2615cb9-cf69-4021-ac52-e5c8ef2e941e tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:33:46.415305 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-f2615cb9-cf69-4021-ac52-e5c8ef2e941e tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1262 microversion: 2.1 time: 0.239251 Feb 16 14:33:46.415305 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 500/1061] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:33:46 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1262 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:33:47.424155 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-7b2f762d-4637-4348-b2e3-17a44155a1df tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:33:47.424972 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-7b2f762d-4637-4348-b2e3-17a44155a1df tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:33:47.433982 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7b2f762d-4637-4348-b2e3-17a44155a1df tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:47.433982 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7b2f762d-4637-4348-b2e3-17a44155a1df tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:47.434210 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7b2f762d-4637-4348-b2e3-17a44155a1df tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:47.434648 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-7b2f762d-4637-4348-b2e3-17a44155a1df tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:47.576476 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-7b2f762d-4637-4348-b2e3-17a44155a1df tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:33:47.584484 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-7b2f762d-4637-4348-b2e3-17a44155a1df tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1262 microversion: 2.1 time: 0.165421 Feb 16 14:33:47.585036 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 562/1062] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:33:47 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1262 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:33:48.601395 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-d0ad1d92-a161-42ad-b1f7-74568b64e207 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:33:48.602107 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-d0ad1d92-a161-42ad-b1f7-74568b64e207 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:33:48.608413 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d0ad1d92-a161-42ad-b1f7-74568b64e207 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:48.608901 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d0ad1d92-a161-42ad-b1f7-74568b64e207 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:48.609681 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d0ad1d92-a161-42ad-b1f7-74568b64e207 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:48.610292 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d0ad1d92-a161-42ad-b1f7-74568b64e207 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:48.768811 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d0ad1d92-a161-42ad-b1f7-74568b64e207 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:33:48.778165 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-d0ad1d92-a161-42ad-b1f7-74568b64e207 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1262 microversion: 2.1 time: 0.180383 Feb 16 14:33:48.779395 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 501/1063] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:33:48 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1262 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:33:49.795620 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-659c3845-aa0e-4663-93b2-30af58e835ee tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:33:49.796245 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-659c3845-aa0e-4663-93b2-30af58e835ee tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:33:49.802761 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-659c3845-aa0e-4663-93b2-30af58e835ee tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:49.803213 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-659c3845-aa0e-4663-93b2-30af58e835ee tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:49.804013 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-659c3845-aa0e-4663-93b2-30af58e835ee tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:49.804453 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-659c3845-aa0e-4663-93b2-30af58e835ee tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:49.937840 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-659c3845-aa0e-4663-93b2-30af58e835ee tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:33:49.945088 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-659c3845-aa0e-4663-93b2-30af58e835ee tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1262 microversion: 2.1 time: 0.153109 Feb 16 14:33:49.945651 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 563/1064] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:33:49 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1262 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:33:50.962286 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-1cae0322-7d18-4ae7-ba3e-e3632ff99c33 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:33:50.962935 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-1cae0322-7d18-4ae7-ba3e-e3632ff99c33 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:33:50.969780 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1cae0322-7d18-4ae7-ba3e-e3632ff99c33 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:50.970231 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1cae0322-7d18-4ae7-ba3e-e3632ff99c33 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:50.971038 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1cae0322-7d18-4ae7-ba3e-e3632ff99c33 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:50.971487 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1cae0322-7d18-4ae7-ba3e-e3632ff99c33 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:51.109424 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-1cae0322-7d18-4ae7-ba3e-e3632ff99c33 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:33:51.116738 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-1cae0322-7d18-4ae7-ba3e-e3632ff99c33 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1262 microversion: 2.1 time: 0.158172 Feb 16 14:33:51.117308 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 502/1065] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:33:50 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1262 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:33:52.133034 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-916b9ba1-26e5-4dc8-b581-e3021fa6598c tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:33:52.133748 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-916b9ba1-26e5-4dc8-b581-e3021fa6598c tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:33:52.140063 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-916b9ba1-26e5-4dc8-b581-e3021fa6598c tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:52.140515 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-916b9ba1-26e5-4dc8-b581-e3021fa6598c tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:52.141286 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-916b9ba1-26e5-4dc8-b581-e3021fa6598c tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:52.141715 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-916b9ba1-26e5-4dc8-b581-e3021fa6598c tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:52.276469 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-916b9ba1-26e5-4dc8-b581-e3021fa6598c tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:33:52.284818 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-916b9ba1-26e5-4dc8-b581-e3021fa6598c tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1262 microversion: 2.1 time: 0.155488 Feb 16 14:33:52.285380 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 564/1066] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:33:52 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1262 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:33:53.302158 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-dd2f10f6-1142-4e5a-b477-eb8cb0b8bbe2 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:33:53.302830 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-dd2f10f6-1142-4e5a-b477-eb8cb0b8bbe2 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:33:53.309280 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dd2f10f6-1142-4e5a-b477-eb8cb0b8bbe2 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:53.319571 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dd2f10f6-1142-4e5a-b477-eb8cb0b8bbe2 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:53.319571 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dd2f10f6-1142-4e5a-b477-eb8cb0b8bbe2 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:53.319571 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dd2f10f6-1142-4e5a-b477-eb8cb0b8bbe2 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:53.455080 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-dd2f10f6-1142-4e5a-b477-eb8cb0b8bbe2 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:33:53.462608 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-dd2f10f6-1142-4e5a-b477-eb8cb0b8bbe2 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1262 microversion: 2.1 time: 0.165091 Feb 16 14:33:53.463281 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 503/1067] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:33:53 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1262 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:33:54.480082 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-4725d698-d509-49ed-8fa3-c6c541025573 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:33:54.480619 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-4725d698-d509-49ed-8fa3-c6c541025573 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:33:54.487703 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4725d698-d509-49ed-8fa3-c6c541025573 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:54.488185 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4725d698-d509-49ed-8fa3-c6c541025573 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:54.488973 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4725d698-d509-49ed-8fa3-c6c541025573 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:54.489410 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4725d698-d509-49ed-8fa3-c6c541025573 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:54.620205 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-4725d698-d509-49ed-8fa3-c6c541025573 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:33:54.627520 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-4725d698-d509-49ed-8fa3-c6c541025573 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1262 microversion: 2.1 time: 0.151213 Feb 16 14:33:54.628094 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 565/1068] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:33:54 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1262 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:33:55.644381 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a9f6a898-dacb-46d8-8bdc-d22f59eb10a7 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:33:55.644940 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a9f6a898-dacb-46d8-8bdc-d22f59eb10a7 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:33:55.651610 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a9f6a898-dacb-46d8-8bdc-d22f59eb10a7 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:55.652061 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a9f6a898-dacb-46d8-8bdc-d22f59eb10a7 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:55.652848 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a9f6a898-dacb-46d8-8bdc-d22f59eb10a7 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:55.653291 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a9f6a898-dacb-46d8-8bdc-d22f59eb10a7 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:55.812327 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a9f6a898-dacb-46d8-8bdc-d22f59eb10a7 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:33:55.820216 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a9f6a898-dacb-46d8-8bdc-d22f59eb10a7 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1262 microversion: 2.1 time: 0.179946 Feb 16 14:33:55.820783 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 504/1069] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:33:55 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1262 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:33:56.838641 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-5c5ee6b3-0699-40b1-81b5-aad08b7e3814 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:33:56.839251 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-5c5ee6b3-0699-40b1-81b5-aad08b7e3814 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:33:56.846118 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5c5ee6b3-0699-40b1-81b5-aad08b7e3814 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:56.846578 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5c5ee6b3-0699-40b1-81b5-aad08b7e3814 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:56.847390 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5c5ee6b3-0699-40b1-81b5-aad08b7e3814 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:56.847828 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5c5ee6b3-0699-40b1-81b5-aad08b7e3814 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:56.988105 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-5c5ee6b3-0699-40b1-81b5-aad08b7e3814 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:33:56.995307 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-5c5ee6b3-0699-40b1-81b5-aad08b7e3814 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1262 microversion: 2.1 time: 0.160294 Feb 16 14:33:56.995873 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 566/1070] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:33:56 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1262 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:33:58.011333 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-639555be-3291-4326-8413-55e1e4b8eb9e tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:33:58.011868 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-639555be-3291-4326-8413-55e1e4b8eb9e tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:33:58.018809 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-639555be-3291-4326-8413-55e1e4b8eb9e tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:58.022548 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-639555be-3291-4326-8413-55e1e4b8eb9e tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:58.022548 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-639555be-3291-4326-8413-55e1e4b8eb9e tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:58.022548 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-639555be-3291-4326-8413-55e1e4b8eb9e tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:58.154289 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-639555be-3291-4326-8413-55e1e4b8eb9e tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:33:58.162677 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-639555be-3291-4326-8413-55e1e4b8eb9e tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1262 microversion: 2.1 time: 0.155051 Feb 16 14:33:58.163272 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 505/1071] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:33:58 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1262 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:33:58.498500 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-a2f456ef-4a09-4bf7-9059-0213696adace req-65bdc2f0-15a8-4737-91b2-9fff99d53829 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c27f46dc-b073-4643-aecd-9706f8a2bd6a", "name": "network-vif-plugged", "status": "completed", "tag": "ed3741ec-f06d-46ec-8c0b-7eba0140cb02"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:33:58.500256 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:33:58.500256 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:33:58.507883 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-a2f456ef-4a09-4bf7-9059-0213696adace req-65bdc2f0-15a8-4737-91b2-9fff99d53829 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:58.508361 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-a2f456ef-4a09-4bf7-9059-0213696adace req-65bdc2f0-15a8-4737-91b2-9fff99d53829 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:58.521209 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-a2f456ef-4a09-4bf7-9059-0213696adace req-65bdc2f0-15a8-4737-91b2-9fff99d53829 service nova] Creating event network-vif-plugged:ed3741ec-f06d-46ec-8c0b-7eba0140cb02 for instance c27f46dc-b073-4643-aecd-9706f8a2bd6a on hv-cinder-80473 Feb 16 14:33:58.526184 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-a2f456ef-4a09-4bf7-9059-0213696adace req-65bdc2f0-15a8-4737-91b2-9fff99d53829 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031726 Feb 16 14:33:58.526783 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 567/1072] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 14:33:59.181180 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-04216493-ae96-438c-9860-b57f41543bc6 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:33:59.181800 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-04216493-ae96-438c-9860-b57f41543bc6 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:33:59.188895 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-04216493-ae96-438c-9860-b57f41543bc6 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:59.189490 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-04216493-ae96-438c-9860-b57f41543bc6 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:59.190292 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-04216493-ae96-438c-9860-b57f41543bc6 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:33:59.190772 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-04216493-ae96-438c-9860-b57f41543bc6 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:33:59.332894 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-04216493-ae96-438c-9860-b57f41543bc6 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:33:59.340255 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-04216493-ae96-438c-9860-b57f41543bc6 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1262 microversion: 2.1 time: 0.162846 Feb 16 14:33:59.340824 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 506/1073] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:33:59 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1262 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:34:00.357984 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-b2bbec72-5ff3-4a49-9b06-3aa63984bc04 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:34:00.358705 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-b2bbec72-5ff3-4a49-9b06-3aa63984bc04 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:34:00.369711 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b2bbec72-5ff3-4a49-9b06-3aa63984bc04 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:00.369711 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b2bbec72-5ff3-4a49-9b06-3aa63984bc04 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:00.369711 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b2bbec72-5ff3-4a49-9b06-3aa63984bc04 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:00.369711 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-b2bbec72-5ff3-4a49-9b06-3aa63984bc04 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:00.513370 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-b2bbec72-5ff3-4a49-9b06-3aa63984bc04 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:34:00.521117 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-b2bbec72-5ff3-4a49-9b06-3aa63984bc04 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1447 microversion: 2.1 time: 0.167567 Feb 16 14:34:00.521687 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 568/1074] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:34:00 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1447 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:34:00.537393 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-2754a77a-52f3-41cd-a8a2-42a59da5eeb3 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:34:00.538009 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-2754a77a-52f3-41cd-a8a2-42a59da5eeb3 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:34:00.545244 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2754a77a-52f3-41cd-a8a2-42a59da5eeb3 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:00.545979 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2754a77a-52f3-41cd-a8a2-42a59da5eeb3 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:00.547998 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2754a77a-52f3-41cd-a8a2-42a59da5eeb3 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:00.548860 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2754a77a-52f3-41cd-a8a2-42a59da5eeb3 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:00.688567 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-2754a77a-52f3-41cd-a8a2-42a59da5eeb3 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:34:00.695981 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-2754a77a-52f3-41cd-a8a2-42a59da5eeb3 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1447 microversion: 2.1 time: 0.162253 Feb 16 14:34:00.696553 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 507/1075] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:34:00 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1447 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:34:02.832207 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-ea0f79c3-60b6-4ad5-aaed-bee042975e28 req-0b35acda-2734-480a-9a37-04a1b93c58b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c27f46dc-b073-4643-aecd-9706f8a2bd6a", "tag": "ed3741ec-f06d-46ec-8c0b-7eba0140cb02"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:34:02.834390 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:34:02.834390 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:34:02.841817 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-ea0f79c3-60b6-4ad5-aaed-bee042975e28 req-0b35acda-2734-480a-9a37-04a1b93c58b3 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:02.842253 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-ea0f79c3-60b6-4ad5-aaed-bee042975e28 req-0b35acda-2734-480a-9a37-04a1b93c58b3 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:02.855431 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-ea0f79c3-60b6-4ad5-aaed-bee042975e28 req-0b35acda-2734-480a-9a37-04a1b93c58b3 service nova] Creating event network-changed:ed3741ec-f06d-46ec-8c0b-7eba0140cb02 for instance c27f46dc-b073-4643-aecd-9706f8a2bd6a on hv-cinder-80473 Feb 16 14:34:02.860503 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-ea0f79c3-60b6-4ad5-aaed-bee042975e28 req-0b35acda-2734-480a-9a37-04a1b93c58b3 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032553 Feb 16 14:34:02.861463 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 569/1076] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:34:15.213442 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-dc332d1d-31d3-4e91-9952-98eeff8f9c7f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:34:15.214036 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-dc332d1d-31d3-4e91-9952-98eeff8f9c7f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: cc0fdcf7-b856-43f5-b061-b03d687c327f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:34:15.219978 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dc332d1d-31d3-4e91-9952-98eeff8f9c7f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:15.220430 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dc332d1d-31d3-4e91-9952-98eeff8f9c7f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:15.221913 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dc332d1d-31d3-4e91-9952-98eeff8f9c7f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:15.222358 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-dc332d1d-31d3-4e91-9952-98eeff8f9c7f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:15.251717 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-dc332d1d-31d3-4e91-9952-98eeff8f9c7f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: cc0fdcf7-b856-43f5-b061-b03d687c327f] Going to try to terminate instance {{(pid=117032) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 16 14:34:15.450326 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-dc332d1d-31d3-4e91-9952-98eeff8f9c7f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "DELETE /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f" status: 204 len: 0 microversion: 2.1 time: 0.240278 Feb 16 14:34:15.451087 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 508/1077] 10.222.0.110 () {58 vars in 1243 bytes} [Wed Feb 16 14:34:15 2022] DELETE /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 16 14:34:15.460269 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-fd2df831-5578-4695-b39f-31a5057d4a84 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:34:15.460962 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-fd2df831-5578-4695-b39f-31a5057d4a84 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: cc0fdcf7-b856-43f5-b061-b03d687c327f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:34:15.467220 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-fd2df831-5578-4695-b39f-31a5057d4a84 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:15.467663 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-fd2df831-5578-4695-b39f-31a5057d4a84 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:15.468468 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-fd2df831-5578-4695-b39f-31a5057d4a84 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:15.469008 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-fd2df831-5578-4695-b39f-31a5057d4a84 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:15.605094 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-fd2df831-5578-4695-b39f-31a5057d4a84 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:34:15.613443 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-fd2df831-5578-4695-b39f-31a5057d4a84 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f" status: 200 len: 1580 microversion: 2.1 time: 0.157946 Feb 16 14:34:15.614016 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 570/1078] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:34:15 2022] GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f => generated 1580 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:34:16.632114 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b268b1e6-b257-4568-adb9-3611f1c564a2 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:34:16.632819 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b268b1e6-b257-4568-adb9-3611f1c564a2 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: cc0fdcf7-b856-43f5-b061-b03d687c327f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:34:16.639403 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b268b1e6-b257-4568-adb9-3611f1c564a2 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:16.639856 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b268b1e6-b257-4568-adb9-3611f1c564a2 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:16.640644 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b268b1e6-b257-4568-adb9-3611f1c564a2 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:16.641137 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b268b1e6-b257-4568-adb9-3611f1c564a2 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:16.779488 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b268b1e6-b257-4568-adb9-3611f1c564a2 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:34:16.787143 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b268b1e6-b257-4568-adb9-3611f1c564a2 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f" status: 200 len: 1580 microversion: 2.1 time: 0.160149 Feb 16 14:34:16.787718 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 509/1079] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:34:16 2022] GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f => generated 1580 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:34:17.804148 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-377ab294-d7f3-4ef2-9b69-04e2013a3796 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:34:17.804763 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-377ab294-d7f3-4ef2-9b69-04e2013a3796 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: cc0fdcf7-b856-43f5-b061-b03d687c327f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:34:17.812064 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-377ab294-d7f3-4ef2-9b69-04e2013a3796 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:17.812514 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-377ab294-d7f3-4ef2-9b69-04e2013a3796 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:17.813321 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-377ab294-d7f3-4ef2-9b69-04e2013a3796 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:17.813757 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-377ab294-d7f3-4ef2-9b69-04e2013a3796 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:17.966164 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-377ab294-d7f3-4ef2-9b69-04e2013a3796 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:34:17.973806 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-377ab294-d7f3-4ef2-9b69-04e2013a3796 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f" status: 200 len: 1580 microversion: 2.1 time: 0.173418 Feb 16 14:34:17.974380 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 571/1080] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:34:17 2022] GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f => generated 1580 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:34:18.670466 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-77290122-916e-41e3-ab07-d04fea422349 req-0d84dfdd-fa95-4e09-b1eb-0661db0271c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc0fdcf7-b856-43f5-b061-b03d687c327f", "name": "network-vif-deleted", "tag": "14aabd43-ae85-477e-98bf-28c418d8f834"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:34:18.672177 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:34:18.672177 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: warnings.warn(msg) Feb 16 14:34:18.683675 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-77290122-916e-41e3-ab07-d04fea422349 req-0d84dfdd-fa95-4e09-b1eb-0661db0271c3 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:18.684199 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-77290122-916e-41e3-ab07-d04fea422349 req-0d84dfdd-fa95-4e09-b1eb-0661db0271c3 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:18.695821 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-77290122-916e-41e3-ab07-d04fea422349 req-0d84dfdd-fa95-4e09-b1eb-0661db0271c3 service nova] Creating event network-vif-deleted:14aabd43-ae85-477e-98bf-28c418d8f834 for instance cc0fdcf7-b856-43f5-b061-b03d687c327f on hv-cinder-80473 Feb 16 14:34:18.701541 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-77290122-916e-41e3-ab07-d04fea422349 req-0d84dfdd-fa95-4e09-b1eb-0661db0271c3 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034671 Feb 16 14:34:18.702679 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 510/1081] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:34:18.990714 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-8d7db653-b450-4a93-93a2-2ea55d24c398 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:34:18.991409 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-8d7db653-b450-4a93-93a2-2ea55d24c398 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: cc0fdcf7-b856-43f5-b061-b03d687c327f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:34:19.002934 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8d7db653-b450-4a93-93a2-2ea55d24c398 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:19.002934 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8d7db653-b450-4a93-93a2-2ea55d24c398 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:19.002934 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8d7db653-b450-4a93-93a2-2ea55d24c398 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:19.003463 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8d7db653-b450-4a93-93a2-2ea55d24c398 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:19.071269 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-8d7db653-b450-4a93-93a2-2ea55d24c398 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:34:19.079463 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-8d7db653-b450-4a93-93a2-2ea55d24c398 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f" status: 200 len: 1227 microversion: 2.1 time: 0.092971 Feb 16 14:34:19.080357 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 572/1082] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:34:18 2022] GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f => generated 1227 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:34:20.097602 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e47ba963-6e28-43b1-afeb-4e9184f31c69 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:34:20.098416 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-e47ba963-6e28-43b1-afeb-4e9184f31c69 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: cc0fdcf7-b856-43f5-b061-b03d687c327f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:34:20.104732 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e47ba963-6e28-43b1-afeb-4e9184f31c69 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:20.105176 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e47ba963-6e28-43b1-afeb-4e9184f31c69 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:20.105958 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e47ba963-6e28-43b1-afeb-4e9184f31c69 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:20.106396 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e47ba963-6e28-43b1-afeb-4e9184f31c69 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:20.120540 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-e47ba963-6e28-43b1-afeb-4e9184f31c69 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] HTTP exception thrown: Instance cc0fdcf7-b856-43f5-b061-b03d687c327f could not be found. Feb 16 14:34:20.121161 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e47ba963-6e28-43b1-afeb-4e9184f31c69 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Returning 404 to user: Instance cc0fdcf7-b856-43f5-b061-b03d687c327f could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:34:20.127674 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-e47ba963-6e28-43b1-afeb-4e9184f31c69 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f" status: 404 len: 111 microversion: 2.1 time: 0.029532 Feb 16 14:34:20.131969 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 511/1083] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:34:20 2022] GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 14:34:20.227044 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-3eeda142-a5f8-46ce-9a0b-fdc0cdd78116 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2076681740", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-203474760", "security_groups": [{"name": "tempest-secgroup-smoke-1368858584"}], "block_device_mapping_v2": [{"uuid": "1c376a9d-96f5-4afc-a40a-7320c268fc1b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0af86f90-4507-47db-8c2b-277aef0456a0"}]}} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:34:20.347729 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.network.neutron [None req-3eeda142-a5f8-46ce-9a0b-fdc0cdd78116 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] validate_networks() for [('0af86f90-4507-47db-8c2b-277aef0456a0', None, None, None, None, None)] {{(pid=117031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 16 14:34:20.775820 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-3eeda142-a5f8-46ce-9a0b-fdc0cdd78116 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Flavor limits 0:0:0 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 16 14:34:20.776248 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-3eeda142-a5f8-46ce-9a0b-fdc0cdd78116 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Image limits 0:0:0 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 16 14:34:20.776729 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-3eeda142-a5f8-46ce-9a0b-fdc0cdd78116 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Flavor pref 0:0:0 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 16 14:34:20.777147 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-3eeda142-a5f8-46ce-9a0b-fdc0cdd78116 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Image pref 0:0:0 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 16 14:34:20.777592 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-3eeda142-a5f8-46ce-9a0b-fdc0cdd78116 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 16 14:34:20.786967 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3eeda142-a5f8-46ce-9a0b-fdc0cdd78116 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:20.787424 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3eeda142-a5f8-46ce-9a0b-fdc0cdd78116 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:20.788301 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3eeda142-a5f8-46ce-9a0b-fdc0cdd78116 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:20.788774 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3eeda142-a5f8-46ce-9a0b-fdc0cdd78116 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:20.809974 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.quota [None req-3eeda142-a5f8-46ce-9a0b-fdc0cdd78116 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Getting quotas for project a072f4cf28da4e14b3fd13b1ba2a9686. Resources: {'cores', 'instances', 'ram'} {{(pid=117031) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 14:34:20.814191 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.quota [None req-3eeda142-a5f8-46ce-9a0b-fdc0cdd78116 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Getting quotas for user 44f75877ea98492e95bfe67b250891e6 and project a072f4cf28da4e14b3fd13b1ba2a9686. Resources: {'cores', 'instances', 'ram'} {{(pid=117031) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 14:34:20.876110 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-3eeda142-a5f8-46ce-9a0b-fdc0cdd78116 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Going to run 1 instances... {{(pid=117031) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 16 14:34:20.878308 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-3eeda142-a5f8-46ce-9a0b-fdc0cdd78116 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: be436bc5-0a4e-4eb3-bea3-a921f56dd41c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1c376a9d-96f5-4afc-a40a-7320c268fc1b',volume_size=None,volume_type=None)] {{(pid=117031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 16 14:34:21.446203 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-3eeda142-a5f8-46ce-9a0b-fdc0cdd78116 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.222911 Feb 16 14:34:21.446993 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 573/1084] 10.222.0.110 () {60 vars in 1151 bytes} [Wed Feb 16 14:34:20 2022] POST /compute/v2.1/servers => generated 408 bytes in 1224 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Feb 16 14:34:21.461205 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-fd6db441-bb40-48a0-9ff0-4b8cce37abc7 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:34:21.462168 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-fd6db441-bb40-48a0-9ff0-4b8cce37abc7 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: be436bc5-0a4e-4eb3-bea3-a921f56dd41c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:34:21.522075 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-fd6db441-bb40-48a0-9ff0-4b8cce37abc7 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:34:21.539994 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-fd6db441-bb40-48a0-9ff0-4b8cce37abc7 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c" status: 200 len: 1097 microversion: 2.1 time: 0.071934 Feb 16 14:34:21.539994 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 512/1085] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:34:21 2022] GET /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c => generated 1097 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:34:22.547643 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-1c3ac90a-9bf8-4949-83ef-0b971bf43275 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:34:22.548207 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-1c3ac90a-9bf8-4949-83ef-0b971bf43275 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: be436bc5-0a4e-4eb3-bea3-a921f56dd41c] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:34:22.555129 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1c3ac90a-9bf8-4949-83ef-0b971bf43275 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:22.555587 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1c3ac90a-9bf8-4949-83ef-0b971bf43275 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:22.556415 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1c3ac90a-9bf8-4949-83ef-0b971bf43275 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:22.556853 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1c3ac90a-9bf8-4949-83ef-0b971bf43275 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:22.620205 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-1c3ac90a-9bf8-4949-83ef-0b971bf43275 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:34:22.628029 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-1c3ac90a-9bf8-4949-83ef-0b971bf43275 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c" status: 200 len: 1147 microversion: 2.1 time: 0.084625 Feb 16 14:34:22.628613 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 574/1086] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:34:22 2022] GET /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c => generated 1147 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:34:23.646208 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-5f89a716-45be-4838-b3b8-87fb58511d86 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:34:23.646817 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-5f89a716-45be-4838-b3b8-87fb58511d86 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: be436bc5-0a4e-4eb3-bea3-a921f56dd41c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:34:23.660462 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5f89a716-45be-4838-b3b8-87fb58511d86 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:23.660976 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5f89a716-45be-4838-b3b8-87fb58511d86 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:23.661992 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5f89a716-45be-4838-b3b8-87fb58511d86 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:23.662436 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-5f89a716-45be-4838-b3b8-87fb58511d86 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:23.731829 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-5f89a716-45be-4838-b3b8-87fb58511d86 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:34:23.740882 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-5f89a716-45be-4838-b3b8-87fb58511d86 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c" status: 200 len: 1203 microversion: 2.1 time: 0.100434 Feb 16 14:34:23.741467 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 513/1087] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:34:23 2022] GET /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c => generated 1203 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:34:24.758600 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-dc8e990c-7e08-4865-b623-27446d5d367f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:34:24.759231 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-dc8e990c-7e08-4865-b623-27446d5d367f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: be436bc5-0a4e-4eb3-bea3-a921f56dd41c] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:34:24.765691 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-dc8e990c-7e08-4865-b623-27446d5d367f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:24.766138 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-dc8e990c-7e08-4865-b623-27446d5d367f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:24.767094 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-dc8e990c-7e08-4865-b623-27446d5d367f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:24.767528 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-dc8e990c-7e08-4865-b623-27446d5d367f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:24.911584 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-dc8e990c-7e08-4865-b623-27446d5d367f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:34:24.943436 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-dc8e990c-7e08-4865-b623-27446d5d367f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c" status: 200 len: 1281 microversion: 2.1 time: 0.188583 Feb 16 14:34:24.944022 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 575/1088] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:34:24 2022] GET /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c => generated 1281 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:34:25.385130 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-c690d914-773e-4b73-b549-c9719a86ea6c req-e11557da-816a-4082-bb8f-f88a5c915ff7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be436bc5-0a4e-4eb3-bea3-a921f56dd41c", "tag": "cb1eeeba-3f72-41f2-8ee0-e94ead41dcdb"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:34:25.388079 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:34:25.388079 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: warnings.warn(msg) Feb 16 14:34:25.396107 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-c690d914-773e-4b73-b549-c9719a86ea6c req-e11557da-816a-4082-bb8f-f88a5c915ff7 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:25.398719 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-c690d914-773e-4b73-b549-c9719a86ea6c req-e11557da-816a-4082-bb8f-f88a5c915ff7 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:25.408422 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-c690d914-773e-4b73-b549-c9719a86ea6c req-e11557da-816a-4082-bb8f-f88a5c915ff7 service nova] Creating event network-changed:cb1eeeba-3f72-41f2-8ee0-e94ead41dcdb for instance be436bc5-0a4e-4eb3-bea3-a921f56dd41c on hv-cinder-80473 Feb 16 14:34:25.414457 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-c690d914-773e-4b73-b549-c9719a86ea6c req-e11557da-816a-4082-bb8f-f88a5c915ff7 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035302 Feb 16 14:34:25.415106 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 514/1089] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:34:25.960227 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-bba92623-ce9e-48f0-a1be-5c91c13bb115 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:34:25.960941 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-bba92623-ce9e-48f0-a1be-5c91c13bb115 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: be436bc5-0a4e-4eb3-bea3-a921f56dd41c] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:34:25.967247 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-bba92623-ce9e-48f0-a1be-5c91c13bb115 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:25.967760 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-bba92623-ce9e-48f0-a1be-5c91c13bb115 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:25.968600 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-bba92623-ce9e-48f0-a1be-5c91c13bb115 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:25.969098 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-bba92623-ce9e-48f0-a1be-5c91c13bb115 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:26.108345 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-bba92623-ce9e-48f0-a1be-5c91c13bb115 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:34:26.116101 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-bba92623-ce9e-48f0-a1be-5c91c13bb115 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c" status: 200 len: 1269 microversion: 2.1 time: 0.160022 Feb 16 14:34:26.116513 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 576/1090] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:34:25 2022] GET /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:34:27.133536 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-80e3044b-1a1f-45f6-8d25-eea6da53ca50 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:34:27.134244 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-80e3044b-1a1f-45f6-8d25-eea6da53ca50 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: be436bc5-0a4e-4eb3-bea3-a921f56dd41c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:34:27.140321 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-80e3044b-1a1f-45f6-8d25-eea6da53ca50 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:27.140776 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-80e3044b-1a1f-45f6-8d25-eea6da53ca50 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:27.141567 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-80e3044b-1a1f-45f6-8d25-eea6da53ca50 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:27.142007 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-80e3044b-1a1f-45f6-8d25-eea6da53ca50 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:27.290980 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-80e3044b-1a1f-45f6-8d25-eea6da53ca50 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:34:27.299039 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-80e3044b-1a1f-45f6-8d25-eea6da53ca50 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c" status: 200 len: 1269 microversion: 2.1 time: 0.169893 Feb 16 14:34:27.300363 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 515/1091] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:34:27 2022] GET /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c => generated 1269 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:34:28.316178 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-85663105-e6ed-4f6e-9c61-917ed60737fe tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:34:28.316781 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-85663105-e6ed-4f6e-9c61-917ed60737fe tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: be436bc5-0a4e-4eb3-bea3-a921f56dd41c] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:34:28.323136 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-85663105-e6ed-4f6e-9c61-917ed60737fe tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:28.323587 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-85663105-e6ed-4f6e-9c61-917ed60737fe tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:28.324371 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-85663105-e6ed-4f6e-9c61-917ed60737fe tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:28.324805 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-85663105-e6ed-4f6e-9c61-917ed60737fe tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:28.466785 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-85663105-e6ed-4f6e-9c61-917ed60737fe tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:34:28.474310 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-85663105-e6ed-4f6e-9c61-917ed60737fe tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c" status: 200 len: 1269 microversion: 2.1 time: 0.162343 Feb 16 14:34:28.474910 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 577/1092] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:34:28 2022] GET /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c => generated 1269 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:34:29.490834 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-04cc1de4-1e18-4cee-b26b-983a1ed9d3cc tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:34:29.491450 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-04cc1de4-1e18-4cee-b26b-983a1ed9d3cc tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: be436bc5-0a4e-4eb3-bea3-a921f56dd41c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:34:29.497935 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-04cc1de4-1e18-4cee-b26b-983a1ed9d3cc tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:29.498393 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-04cc1de4-1e18-4cee-b26b-983a1ed9d3cc tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:29.499208 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-04cc1de4-1e18-4cee-b26b-983a1ed9d3cc tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:29.499646 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-04cc1de4-1e18-4cee-b26b-983a1ed9d3cc tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:29.632986 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-04cc1de4-1e18-4cee-b26b-983a1ed9d3cc tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:34:29.640145 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-04cc1de4-1e18-4cee-b26b-983a1ed9d3cc tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c" status: 200 len: 1269 microversion: 2.1 time: 0.153146 Feb 16 14:34:29.640700 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 516/1093] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:34:29 2022] GET /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c => generated 1269 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:34:30.657063 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-5225ee94-28f8-42bd-8742-697036871f06 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:34:30.657698 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-5225ee94-28f8-42bd-8742-697036871f06 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: be436bc5-0a4e-4eb3-bea3-a921f56dd41c] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:34:30.664496 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5225ee94-28f8-42bd-8742-697036871f06 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:30.664945 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5225ee94-28f8-42bd-8742-697036871f06 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:30.665725 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5225ee94-28f8-42bd-8742-697036871f06 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:30.666161 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5225ee94-28f8-42bd-8742-697036871f06 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:30.801664 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-5225ee94-28f8-42bd-8742-697036871f06 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:34:30.808859 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-5225ee94-28f8-42bd-8742-697036871f06 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c" status: 200 len: 1269 microversion: 2.1 time: 0.155476 Feb 16 14:34:30.809425 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 578/1094] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:34:30 2022] GET /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c => generated 1269 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:34:31.826055 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b79ed597-7b33-46c4-b0d1-816958008f18 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:34:31.826725 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b79ed597-7b33-46c4-b0d1-816958008f18 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: be436bc5-0a4e-4eb3-bea3-a921f56dd41c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:34:31.833574 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b79ed597-7b33-46c4-b0d1-816958008f18 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:31.834032 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b79ed597-7b33-46c4-b0d1-816958008f18 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:31.834869 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b79ed597-7b33-46c4-b0d1-816958008f18 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:31.835302 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b79ed597-7b33-46c4-b0d1-816958008f18 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:31.972359 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b79ed597-7b33-46c4-b0d1-816958008f18 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:34:31.979576 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b79ed597-7b33-46c4-b0d1-816958008f18 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c" status: 200 len: 1269 microversion: 2.1 time: 0.157458 Feb 16 14:34:31.980131 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 517/1095] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:34:31 2022] GET /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c => generated 1269 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:34:32.996630 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-09533a06-73b3-4c02-9a6a-8670f2a7d447 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:34:32.997296 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-09533a06-73b3-4c02-9a6a-8670f2a7d447 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: be436bc5-0a4e-4eb3-bea3-a921f56dd41c] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:34:33.003567 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-09533a06-73b3-4c02-9a6a-8670f2a7d447 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:33.004008 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-09533a06-73b3-4c02-9a6a-8670f2a7d447 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:33.004780 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-09533a06-73b3-4c02-9a6a-8670f2a7d447 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:33.005207 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-09533a06-73b3-4c02-9a6a-8670f2a7d447 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:33.135483 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-09533a06-73b3-4c02-9a6a-8670f2a7d447 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:34:33.142683 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-09533a06-73b3-4c02-9a6a-8670f2a7d447 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c" status: 200 len: 1269 microversion: 2.1 time: 0.149700 Feb 16 14:34:33.143789 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 579/1096] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:34:32 2022] GET /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c => generated 1269 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:34:34.160167 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-cf4ab334-30fe-4b7f-bcb5-f38651aacb16 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:34:34.160800 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-cf4ab334-30fe-4b7f-bcb5-f38651aacb16 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: be436bc5-0a4e-4eb3-bea3-a921f56dd41c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:34:34.167055 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cf4ab334-30fe-4b7f-bcb5-f38651aacb16 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:34.167504 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cf4ab334-30fe-4b7f-bcb5-f38651aacb16 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:34.168302 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cf4ab334-30fe-4b7f-bcb5-f38651aacb16 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:34.168739 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-cf4ab334-30fe-4b7f-bcb5-f38651aacb16 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:34.309631 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-cf4ab334-30fe-4b7f-bcb5-f38651aacb16 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:34:34.317008 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-cf4ab334-30fe-4b7f-bcb5-f38651aacb16 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c" status: 200 len: 1269 microversion: 2.1 time: 0.161124 Feb 16 14:34:34.317559 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 518/1097] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:34:34 2022] GET /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c => generated 1269 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:34:35.334717 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-c9bab3cf-cec0-4bb8-8b20-532ddf602b00 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:34:35.335328 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-c9bab3cf-cec0-4bb8-8b20-532ddf602b00 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: be436bc5-0a4e-4eb3-bea3-a921f56dd41c] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:34:35.342286 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c9bab3cf-cec0-4bb8-8b20-532ddf602b00 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:35.342770 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c9bab3cf-cec0-4bb8-8b20-532ddf602b00 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:35.343543 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c9bab3cf-cec0-4bb8-8b20-532ddf602b00 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:35.343973 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c9bab3cf-cec0-4bb8-8b20-532ddf602b00 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:35.481700 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-c9bab3cf-cec0-4bb8-8b20-532ddf602b00 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:34:35.489548 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-c9bab3cf-cec0-4bb8-8b20-532ddf602b00 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c" status: 200 len: 1269 microversion: 2.1 time: 0.159640 Feb 16 14:34:35.490119 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 580/1098] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:34:35 2022] GET /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:34:36.506122 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-abf04bcb-5018-4778-ac57-a9a1ef79230f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:34:36.506779 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-abf04bcb-5018-4778-ac57-a9a1ef79230f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: be436bc5-0a4e-4eb3-bea3-a921f56dd41c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:34:36.513098 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-abf04bcb-5018-4778-ac57-a9a1ef79230f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:36.513550 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-abf04bcb-5018-4778-ac57-a9a1ef79230f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:36.514330 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-abf04bcb-5018-4778-ac57-a9a1ef79230f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:36.514806 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-abf04bcb-5018-4778-ac57-a9a1ef79230f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:36.644318 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-ef2156ea-55e6-485c-ae67-9a02c1e80b26 req-2bb5d58a-9337-4a60-b43c-f7ded46dec03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be436bc5-0a4e-4eb3-bea3-a921f56dd41c", "name": "network-vif-plugged", "status": "completed", "tag": "cb1eeeba-3f72-41f2-8ee0-e94ead41dcdb"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:34:36.646923 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:34:36.646923 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:34:36.652923 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-abf04bcb-5018-4778-ac57-a9a1ef79230f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:34:36.653897 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-ef2156ea-55e6-485c-ae67-9a02c1e80b26 req-2bb5d58a-9337-4a60-b43c-f7ded46dec03 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:36.654343 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-ef2156ea-55e6-485c-ae67-9a02c1e80b26 req-2bb5d58a-9337-4a60-b43c-f7ded46dec03 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:36.660825 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-abf04bcb-5018-4778-ac57-a9a1ef79230f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c" status: 200 len: 1269 microversion: 2.1 time: 0.159076 Feb 16 14:34:36.661724 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 519/1099] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:34:36 2022] GET /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c => generated 1269 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:34:36.667233 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-ef2156ea-55e6-485c-ae67-9a02c1e80b26 req-2bb5d58a-9337-4a60-b43c-f7ded46dec03 service nova] Creating event network-vif-plugged:cb1eeeba-3f72-41f2-8ee0-e94ead41dcdb for instance be436bc5-0a4e-4eb3-bea3-a921f56dd41c on hv-cinder-80473 Feb 16 14:34:36.672308 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-ef2156ea-55e6-485c-ae67-9a02c1e80b26 req-2bb5d58a-9337-4a60-b43c-f7ded46dec03 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033349 Feb 16 14:34:36.672849 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 581/1100] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 14:34:37.677142 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-fddbf59a-7744-4f4e-896b-2919a1f6e6fb tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:34:37.677759 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-fddbf59a-7744-4f4e-896b-2919a1f6e6fb tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: be436bc5-0a4e-4eb3-bea3-a921f56dd41c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:34:37.684071 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fddbf59a-7744-4f4e-896b-2919a1f6e6fb tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:37.684526 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fddbf59a-7744-4f4e-896b-2919a1f6e6fb tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:37.685316 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fddbf59a-7744-4f4e-896b-2919a1f6e6fb tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:37.685761 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-fddbf59a-7744-4f4e-896b-2919a1f6e6fb tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:37.819731 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-fddbf59a-7744-4f4e-896b-2919a1f6e6fb tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:34:37.827206 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-fddbf59a-7744-4f4e-896b-2919a1f6e6fb tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c" status: 200 len: 1269 microversion: 2.1 time: 0.153777 Feb 16 14:34:37.827793 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 520/1101] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:34:37 2022] GET /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c => generated 1269 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:34:38.845350 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-5310b242-62f4-4d7f-b8e1-b9ddbaf29b35 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:34:38.846090 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-5310b242-62f4-4d7f-b8e1-b9ddbaf29b35 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: be436bc5-0a4e-4eb3-bea3-a921f56dd41c] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:34:38.852336 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5310b242-62f4-4d7f-b8e1-b9ddbaf29b35 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:38.852787 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5310b242-62f4-4d7f-b8e1-b9ddbaf29b35 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:38.853571 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5310b242-62f4-4d7f-b8e1-b9ddbaf29b35 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:38.854003 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5310b242-62f4-4d7f-b8e1-b9ddbaf29b35 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:38.986258 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-5310b242-62f4-4d7f-b8e1-b9ddbaf29b35 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:34:38.994528 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-5310b242-62f4-4d7f-b8e1-b9ddbaf29b35 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c" status: 200 len: 1455 microversion: 2.1 time: 0.153784 Feb 16 14:34:38.995121 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 582/1102] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:34:38 2022] GET /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c => generated 1455 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:34:39.011189 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e6e16366-35b9-44ef-88cb-709813e631b4 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:34:39.011848 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-e6e16366-35b9-44ef-88cb-709813e631b4 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: be436bc5-0a4e-4eb3-bea3-a921f56dd41c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:34:39.017996 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e6e16366-35b9-44ef-88cb-709813e631b4 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:39.018778 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e6e16366-35b9-44ef-88cb-709813e631b4 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:39.019567 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e6e16366-35b9-44ef-88cb-709813e631b4 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:39.020032 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e6e16366-35b9-44ef-88cb-709813e631b4 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:39.152814 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-e6e16366-35b9-44ef-88cb-709813e631b4 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:34:39.160367 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-e6e16366-35b9-44ef-88cb-709813e631b4 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c" status: 200 len: 1455 microversion: 2.1 time: 0.152940 Feb 16 14:34:39.160930 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 521/1103] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:34:39 2022] GET /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c => generated 1455 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:34:41.377755 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-2a1b405b-6e8c-446c-8707-b3ba7ffe90e0 req-f5eca762-f42c-42f1-9ea2-70ede2e73742 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be436bc5-0a4e-4eb3-bea3-a921f56dd41c", "tag": "cb1eeeba-3f72-41f2-8ee0-e94ead41dcdb"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:34:41.382938 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:34:41.382938 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:34:41.387049 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-2a1b405b-6e8c-446c-8707-b3ba7ffe90e0 req-f5eca762-f42c-42f1-9ea2-70ede2e73742 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:34:41.387541 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-2a1b405b-6e8c-446c-8707-b3ba7ffe90e0 req-f5eca762-f42c-42f1-9ea2-70ede2e73742 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:34:41.399137 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-2a1b405b-6e8c-446c-8707-b3ba7ffe90e0 req-f5eca762-f42c-42f1-9ea2-70ede2e73742 service nova] Creating event network-changed:cb1eeeba-3f72-41f2-8ee0-e94ead41dcdb for instance be436bc5-0a4e-4eb3-bea3-a921f56dd41c on hv-cinder-80473 Feb 16 14:34:41.404926 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-2a1b405b-6e8c-446c-8707-b3ba7ffe90e0 req-f5eca762-f42c-42f1-9ea2-70ede2e73742 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030944 Feb 16 14:34:41.405542 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 583/1104] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:35:52.164853 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 16 14:35:52.165565 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: Wed Feb 16 14:35:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 16 14:35:59.986837 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-0769a105-5f6b-4f1c-8adb-a996ffed294d tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:35:59.987434 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-0769a105-5f6b-4f1c-8adb-a996ffed294d tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:35:59.993275 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0769a105-5f6b-4f1c-8adb-a996ffed294d tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:35:59.993722 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0769a105-5f6b-4f1c-8adb-a996ffed294d tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:35:59.994534 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0769a105-5f6b-4f1c-8adb-a996ffed294d tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:35:59.994998 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0769a105-5f6b-4f1c-8adb-a996ffed294d tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:00.019294 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-0769a105-5f6b-4f1c-8adb-a996ffed294d tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lazy-loading 'flavor' on Instance uuid c27f46dc-b073-4643-aecd-9706f8a2bd6a {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:36:00.274786 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-0769a105-5f6b-4f1c-8adb-a996ffed294d tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "POST /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a/action" status: 202 len: 0 microversion: 2.1 time: 0.292983 Feb 16 14:36:00.275380 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 522/1105] 10.222.0.110 () {60 vars in 1282 bytes} [Wed Feb 16 14:35:59 2022] POST /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Feb 16 14:36:00.285939 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-4f370515-a968-4c53-92b5-c38ba48fe9a4 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:00.286649 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-4f370515-a968-4c53-92b5-c38ba48fe9a4 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:00.292656 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4f370515-a968-4c53-92b5-c38ba48fe9a4 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:00.293105 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4f370515-a968-4c53-92b5-c38ba48fe9a4 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:00.293905 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4f370515-a968-4c53-92b5-c38ba48fe9a4 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:00.294337 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-4f370515-a968-4c53-92b5-c38ba48fe9a4 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:00.576097 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-4f370515-a968-4c53-92b5-c38ba48fe9a4 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:00.584021 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-4f370515-a968-4c53-92b5-c38ba48fe9a4 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1571 microversion: 2.1 time: 0.304140 Feb 16 14:36:00.584586 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 584/1106] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:00 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1571 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:36:01.603385 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-063ed68b-5ef5-4b99-8768-af95c86f5155 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:01.604129 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-063ed68b-5ef5-4b99-8768-af95c86f5155 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:01.610150 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-063ed68b-5ef5-4b99-8768-af95c86f5155 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:01.610601 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-063ed68b-5ef5-4b99-8768-af95c86f5155 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:01.611402 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-063ed68b-5ef5-4b99-8768-af95c86f5155 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:01.611847 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-063ed68b-5ef5-4b99-8768-af95c86f5155 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:01.803837 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-063ed68b-5ef5-4b99-8768-af95c86f5155 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:01.811421 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-063ed68b-5ef5-4b99-8768-af95c86f5155 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1571 microversion: 2.1 time: 0.213143 Feb 16 14:36:01.812129 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 523/1107] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:01 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1571 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:36:02.828756 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-436ed98f-5515-409c-901e-a0fd0db3016f tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:02.829382 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-436ed98f-5515-409c-901e-a0fd0db3016f tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:02.835872 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-436ed98f-5515-409c-901e-a0fd0db3016f tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:02.836317 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-436ed98f-5515-409c-901e-a0fd0db3016f tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:02.837093 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-436ed98f-5515-409c-901e-a0fd0db3016f tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:02.837523 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-436ed98f-5515-409c-901e-a0fd0db3016f tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:02.971857 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-436ed98f-5515-409c-901e-a0fd0db3016f tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:02.979039 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-436ed98f-5515-409c-901e-a0fd0db3016f tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1571 microversion: 2.1 time: 0.153988 Feb 16 14:36:02.979590 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 585/1108] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:02 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1571 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:36:03.996802 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-90fc9953-a230-4b4b-8dde-3d89264355a5 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:03.997449 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-90fc9953-a230-4b4b-8dde-3d89264355a5 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:04.004193 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-90fc9953-a230-4b4b-8dde-3d89264355a5 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:04.004650 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-90fc9953-a230-4b4b-8dde-3d89264355a5 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:04.005435 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-90fc9953-a230-4b4b-8dde-3d89264355a5 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:04.005882 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-90fc9953-a230-4b4b-8dde-3d89264355a5 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:04.146643 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-90fc9953-a230-4b4b-8dde-3d89264355a5 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:04.154350 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-90fc9953-a230-4b4b-8dde-3d89264355a5 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1571 microversion: 2.1 time: 0.161259 Feb 16 14:36:04.154987 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 524/1109] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:03 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1571 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:36:05.182096 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-3ef3c515-90bd-4304-835e-eaaa5b9b2deb tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:05.182096 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-3ef3c515-90bd-4304-835e-eaaa5b9b2deb tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:05.182096 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3ef3c515-90bd-4304-835e-eaaa5b9b2deb tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:05.182096 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3ef3c515-90bd-4304-835e-eaaa5b9b2deb tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:05.182911 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3ef3c515-90bd-4304-835e-eaaa5b9b2deb tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:05.182911 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-3ef3c515-90bd-4304-835e-eaaa5b9b2deb tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:05.312050 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-3ef3c515-90bd-4304-835e-eaaa5b9b2deb tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:05.319321 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-3ef3c515-90bd-4304-835e-eaaa5b9b2deb tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1571 microversion: 2.1 time: 0.151807 Feb 16 14:36:05.319885 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 586/1110] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:05 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1571 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:36:06.336910 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-c62ebd16-bd63-4d05-857f-e4fb481f45bf tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:06.337513 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-c62ebd16-bd63-4d05-857f-e4fb481f45bf tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:06.343810 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c62ebd16-bd63-4d05-857f-e4fb481f45bf tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:06.344250 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c62ebd16-bd63-4d05-857f-e4fb481f45bf tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:06.345024 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c62ebd16-bd63-4d05-857f-e4fb481f45bf tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:06.345455 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-c62ebd16-bd63-4d05-857f-e4fb481f45bf tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:06.480421 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-c62ebd16-bd63-4d05-857f-e4fb481f45bf tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:06.488681 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-c62ebd16-bd63-4d05-857f-e4fb481f45bf tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1571 microversion: 2.1 time: 0.155448 Feb 16 14:36:06.489298 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 525/1111] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:06 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1571 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:36:07.505481 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-cb0c3d50-7d31-4eaf-9e50-1c9007645149 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:07.506093 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-cb0c3d50-7d31-4eaf-9e50-1c9007645149 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:07.512391 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-cb0c3d50-7d31-4eaf-9e50-1c9007645149 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:07.512843 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-cb0c3d50-7d31-4eaf-9e50-1c9007645149 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:07.513618 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-cb0c3d50-7d31-4eaf-9e50-1c9007645149 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:07.514051 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-cb0c3d50-7d31-4eaf-9e50-1c9007645149 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:07.648674 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-cb0c3d50-7d31-4eaf-9e50-1c9007645149 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:07.656520 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-cb0c3d50-7d31-4eaf-9e50-1c9007645149 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1571 microversion: 2.1 time: 0.154725 Feb 16 14:36:07.657079 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 587/1112] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:07 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:36:08.674586 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b99e23c6-8a33-499f-93de-fb7db87e7ee0 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:08.675240 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b99e23c6-8a33-499f-93de-fb7db87e7ee0 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:08.681652 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b99e23c6-8a33-499f-93de-fb7db87e7ee0 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:08.682111 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b99e23c6-8a33-499f-93de-fb7db87e7ee0 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:08.682940 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b99e23c6-8a33-499f-93de-fb7db87e7ee0 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:08.683382 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b99e23c6-8a33-499f-93de-fb7db87e7ee0 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:08.824330 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b99e23c6-8a33-499f-93de-fb7db87e7ee0 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:08.832011 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b99e23c6-8a33-499f-93de-fb7db87e7ee0 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1571 microversion: 2.1 time: 0.162377 Feb 16 14:36:08.832581 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 526/1113] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:08 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1571 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:36:09.848657 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-c8b8ea1a-b422-469d-b436-57edc2cfefe2 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:09.849293 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-c8b8ea1a-b422-469d-b436-57edc2cfefe2 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:09.855491 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c8b8ea1a-b422-469d-b436-57edc2cfefe2 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:09.855940 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c8b8ea1a-b422-469d-b436-57edc2cfefe2 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:09.856714 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c8b8ea1a-b422-469d-b436-57edc2cfefe2 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:09.857149 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c8b8ea1a-b422-469d-b436-57edc2cfefe2 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:09.992219 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-c8b8ea1a-b422-469d-b436-57edc2cfefe2 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:10.000075 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-c8b8ea1a-b422-469d-b436-57edc2cfefe2 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1571 microversion: 2.1 time: 0.155098 Feb 16 14:36:10.000636 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 588/1114] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:09 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:36:11.017545 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-eb537519-308c-49d9-ad7d-10c8aaa175c6 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:11.018206 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-eb537519-308c-49d9-ad7d-10c8aaa175c6 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:11.024372 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-eb537519-308c-49d9-ad7d-10c8aaa175c6 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:11.024823 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-eb537519-308c-49d9-ad7d-10c8aaa175c6 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:11.025641 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-eb537519-308c-49d9-ad7d-10c8aaa175c6 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:11.026081 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-eb537519-308c-49d9-ad7d-10c8aaa175c6 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:11.245042 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-eb537519-308c-49d9-ad7d-10c8aaa175c6 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:11.252924 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-eb537519-308c-49d9-ad7d-10c8aaa175c6 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1571 microversion: 2.1 time: 0.239788 Feb 16 14:36:11.253484 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 527/1115] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:11 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1571 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:36:12.269822 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-d38bdcf4-a318-4853-85ce-5dd69124a84e tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:12.270417 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-d38bdcf4-a318-4853-85ce-5dd69124a84e tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:12.276642 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d38bdcf4-a318-4853-85ce-5dd69124a84e tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:12.277088 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d38bdcf4-a318-4853-85ce-5dd69124a84e tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:12.277855 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d38bdcf4-a318-4853-85ce-5dd69124a84e tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:12.278279 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-d38bdcf4-a318-4853-85ce-5dd69124a84e tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:12.569285 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-d38bdcf4-a318-4853-85ce-5dd69124a84e tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:12.577510 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-d38bdcf4-a318-4853-85ce-5dd69124a84e tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1571 microversion: 2.1 time: 0.310704 Feb 16 14:36:12.578106 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 589/1116] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:12 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1571 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:36:13.594950 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-b43273a2-6649-4499-b398-ceca60ee6875 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:13.595568 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-b43273a2-6649-4499-b398-ceca60ee6875 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:13.601928 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b43273a2-6649-4499-b398-ceca60ee6875 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:13.602382 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b43273a2-6649-4499-b398-ceca60ee6875 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:13.603198 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b43273a2-6649-4499-b398-ceca60ee6875 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:13.603641 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-b43273a2-6649-4499-b398-ceca60ee6875 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:13.739798 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-b43273a2-6649-4499-b398-ceca60ee6875 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:13.747404 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-b43273a2-6649-4499-b398-ceca60ee6875 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1571 microversion: 2.1 time: 0.157027 Feb 16 14:36:13.747921 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 528/1117] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:13 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1571 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:36:14.764539 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-a327732e-6b5b-401b-921c-6f61b6ca4832 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:14.765171 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-a327732e-6b5b-401b-921c-6f61b6ca4832 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:14.773260 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a327732e-6b5b-401b-921c-6f61b6ca4832 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:14.773703 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a327732e-6b5b-401b-921c-6f61b6ca4832 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:14.774703 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a327732e-6b5b-401b-921c-6f61b6ca4832 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:14.775139 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a327732e-6b5b-401b-921c-6f61b6ca4832 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:14.912111 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-a327732e-6b5b-401b-921c-6f61b6ca4832 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:14.919419 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-a327732e-6b5b-401b-921c-6f61b6ca4832 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1571 microversion: 2.1 time: 0.158732 Feb 16 14:36:14.919970 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 590/1118] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:14 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1571 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:36:15.937861 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a9fa1b71-cee0-4d24-bbb9-7ed16c17a80f tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:15.938478 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a9fa1b71-cee0-4d24-bbb9-7ed16c17a80f tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:15.944580 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a9fa1b71-cee0-4d24-bbb9-7ed16c17a80f tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:15.945039 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a9fa1b71-cee0-4d24-bbb9-7ed16c17a80f tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:15.945856 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a9fa1b71-cee0-4d24-bbb9-7ed16c17a80f tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:15.946298 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a9fa1b71-cee0-4d24-bbb9-7ed16c17a80f tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:16.091757 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a9fa1b71-cee0-4d24-bbb9-7ed16c17a80f tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:16.108472 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a9fa1b71-cee0-4d24-bbb9-7ed16c17a80f tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1571 microversion: 2.1 time: 0.166189 Feb 16 14:36:16.108472 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 529/1119] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:15 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1571 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:36:17.117006 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-1cc6f1ef-5975-4079-a514-90cb2e85f70d tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:17.117591 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-1cc6f1ef-5975-4079-a514-90cb2e85f70d tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:17.124808 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1cc6f1ef-5975-4079-a514-90cb2e85f70d tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:17.125370 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1cc6f1ef-5975-4079-a514-90cb2e85f70d tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:17.126208 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1cc6f1ef-5975-4079-a514-90cb2e85f70d tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:17.126686 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1cc6f1ef-5975-4079-a514-90cb2e85f70d tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:17.267983 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-1cc6f1ef-5975-4079-a514-90cb2e85f70d tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:17.275331 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-1cc6f1ef-5975-4079-a514-90cb2e85f70d tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1512 microversion: 2.1 time: 0.162066 Feb 16 14:36:17.275887 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 591/1120] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:17 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:36:17.291273 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-2ba9dc75-7586-4d02-8777-631630e0fb6d tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:36:17.291873 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-2ba9dc75-7586-4d02-8777-631630e0fb6d tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:17.298667 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2ba9dc75-7586-4d02-8777-631630e0fb6d tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:17.299121 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2ba9dc75-7586-4d02-8777-631630e0fb6d tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:17.299904 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2ba9dc75-7586-4d02-8777-631630e0fb6d tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:17.300344 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-2ba9dc75-7586-4d02-8777-631630e0fb6d tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:17.500072 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-2ba9dc75-7586-4d02-8777-631630e0fb6d tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "POST /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a/action" status: 202 len: 0 microversion: 2.1 time: 0.211743 Feb 16 14:36:17.500877 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 530/1121] 10.222.0.110 () {60 vars in 1282 bytes} [Wed Feb 16 14:36:17 2022] POST /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 14:36:17.508998 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-936ea2a6-e4a1-4c04-a2a8-38aa22244b55 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:17.514614 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-936ea2a6-e4a1-4c04-a2a8-38aa22244b55 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:17.515710 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-936ea2a6-e4a1-4c04-a2a8-38aa22244b55 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:17.515819 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-936ea2a6-e4a1-4c04-a2a8-38aa22244b55 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:17.516669 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-936ea2a6-e4a1-4c04-a2a8-38aa22244b55 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:17.517110 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-936ea2a6-e4a1-4c04-a2a8-38aa22244b55 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:17.686344 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-936ea2a6-e4a1-4c04-a2a8-38aa22244b55 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:17.694104 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-936ea2a6-e4a1-4c04-a2a8-38aa22244b55 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1520 microversion: 2.1 time: 0.188701 Feb 16 14:36:17.694702 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 592/1122] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:17 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:36:18.711658 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-a6016de8-014a-4c4f-aa53-2ff11a288c7c tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:18.712277 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-a6016de8-014a-4c4f-aa53-2ff11a288c7c tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:18.718775 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a6016de8-014a-4c4f-aa53-2ff11a288c7c tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:18.719282 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a6016de8-014a-4c4f-aa53-2ff11a288c7c tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:18.720081 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a6016de8-014a-4c4f-aa53-2ff11a288c7c tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:18.720701 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-a6016de8-014a-4c4f-aa53-2ff11a288c7c tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:18.859377 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-a6016de8-014a-4c4f-aa53-2ff11a288c7c tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:18.866573 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-a6016de8-014a-4c4f-aa53-2ff11a288c7c tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1522 microversion: 2.1 time: 0.159189 Feb 16 14:36:18.867550 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 531/1123] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:18 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:36:19.356766 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-4bd1f0b7-a9eb-4c8e-8916-22678b55de6b req-d66202a1-09c8-4e8a-a78d-de2a82d28bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c27f46dc-b073-4643-aecd-9706f8a2bd6a", "name": "network-vif-unplugged", "status": "completed", "tag": "ed3741ec-f06d-46ec-8c0b-7eba0140cb02"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:36:19.358354 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:36:19.358354 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:36:19.365953 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-4bd1f0b7-a9eb-4c8e-8916-22678b55de6b req-d66202a1-09c8-4e8a-a78d-de2a82d28bd1 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:19.366406 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-4bd1f0b7-a9eb-4c8e-8916-22678b55de6b req-d66202a1-09c8-4e8a-a78d-de2a82d28bd1 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:19.377907 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.compute.server_external_events [req-4bd1f0b7-a9eb-4c8e-8916-22678b55de6b req-d66202a1-09c8-4e8a-a78d-de2a82d28bd1 service nova] Unable to find a host for instance c27f46dc-b073-4643-aecd-9706f8a2bd6a. Dropping event network-vif-unplugged {{(pid=117031) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Feb 16 14:36:19.379537 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-4bd1f0b7-a9eb-4c8e-8916-22678b55de6b req-d66202a1-09c8-4e8a-a78d-de2a82d28bd1 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.083976 Feb 16 14:36:19.379537 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 593/1124] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 85 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Feb 16 14:36:19.884458 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-08d79ba0-a41e-4e16-8760-b4363715162c tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:19.885152 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-08d79ba0-a41e-4e16-8760-b4363715162c tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:19.892231 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-08d79ba0-a41e-4e16-8760-b4363715162c tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:19.892682 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-08d79ba0-a41e-4e16-8760-b4363715162c tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:19.893461 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-08d79ba0-a41e-4e16-8760-b4363715162c tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:19.893899 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-08d79ba0-a41e-4e16-8760-b4363715162c tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:20.022542 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-0a0ed05d-02bf-4f2a-9e4c-e7abae0f31ca tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1823162251", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-203474760", "security_groups": [{"name": "tempest-secgroup-smoke-1368858584"}], "block_device_mapping_v2": [{"uuid": "dde0941f-81f7-43f4-8285-84e3fc7af019", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0af86f90-4507-47db-8c2b-277aef0456a0"}]}} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:36:20.039493 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-08d79ba0-a41e-4e16-8760-b4363715162c tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:20.047381 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-08d79ba0-a41e-4e16-8760-b4363715162c tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1522 microversion: 2.1 time: 0.166517 Feb 16 14:36:20.048228 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 532/1125] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:19 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:36:20.133885 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.network.neutron [None req-0a0ed05d-02bf-4f2a-9e4c-e7abae0f31ca tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] validate_networks() for [('0af86f90-4507-47db-8c2b-277aef0456a0', None, None, None, None, None)] {{(pid=117031) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Feb 16 14:36:20.565939 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-0a0ed05d-02bf-4f2a-9e4c-e7abae0f31ca tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Flavor limits 0:0:0 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Feb 16 14:36:20.566504 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-0a0ed05d-02bf-4f2a-9e4c-e7abae0f31ca tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Image limits 0:0:0 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Feb 16 14:36:20.566965 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-0a0ed05d-02bf-4f2a-9e4c-e7abae0f31ca tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Flavor pref 0:0:0 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Feb 16 14:36:20.567402 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-0a0ed05d-02bf-4f2a-9e4c-e7abae0f31ca tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Image pref 0:0:0 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Feb 16 14:36:20.567828 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.virt.hardware [None req-0a0ed05d-02bf-4f2a-9e4c-e7abae0f31ca tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117031) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Feb 16 14:36:20.576559 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0a0ed05d-02bf-4f2a-9e4c-e7abae0f31ca tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:20.580533 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0a0ed05d-02bf-4f2a-9e4c-e7abae0f31ca tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:20.580533 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0a0ed05d-02bf-4f2a-9e4c-e7abae0f31ca tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:20.580533 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-0a0ed05d-02bf-4f2a-9e4c-e7abae0f31ca tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:20.594865 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.quota [None req-0a0ed05d-02bf-4f2a-9e4c-e7abae0f31ca tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Getting quotas for project a072f4cf28da4e14b3fd13b1ba2a9686. Resources: {'cores', 'instances', 'ram'} {{(pid=117031) _get_quotas /opt/stack/nova/nova/quota.py:387}} Feb 16 14:36:20.598890 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.quota [None req-0a0ed05d-02bf-4f2a-9e4c-e7abae0f31ca tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Getting quotas for user 44f75877ea98492e95bfe67b250891e6 and project a072f4cf28da4e14b3fd13b1ba2a9686. Resources: {'cores', 'instances', 'ram'} {{(pid=117031) _get_quotas /opt/stack/nova/nova/quota.py:377}} Feb 16 14:36:20.657524 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-0a0ed05d-02bf-4f2a-9e4c-e7abae0f31ca tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Going to run 1 instances... {{(pid=117031) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Feb 16 14:36:20.659899 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-0a0ed05d-02bf-4f2a-9e4c-e7abae0f31ca tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: d3a6e4c8-bb6c-4d45-ad56-199bb833367b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dde0941f-81f7-43f4-8285-84e3fc7af019',volume_size=None,volume_type=None)] {{(pid=117031) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Feb 16 14:36:21.044177 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-0a0ed05d-02bf-4f2a-9e4c-e7abae0f31ca tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.025181 Feb 16 14:36:21.044933 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 594/1126] 10.222.0.110 () {60 vars in 1151 bytes} [Wed Feb 16 14:36:20 2022] POST /compute/v2.1/servers => generated 408 bytes in 1027 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Feb 16 14:36:21.054948 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6861661c-8edd-47ea-b5ca-d514981f51f6 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:21.055565 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-6861661c-8edd-47ea-b5ca-d514981f51f6 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: d3a6e4c8-bb6c-4d45-ad56-199bb833367b] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:21.064472 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-09d8221b-cfad-49ae-9e6e-22d0d29a2c2a tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:21.065338 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-09d8221b-cfad-49ae-9e6e-22d0d29a2c2a tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:21.071799 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-09d8221b-cfad-49ae-9e6e-22d0d29a2c2a tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:21.072307 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-09d8221b-cfad-49ae-9e6e-22d0d29a2c2a tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:21.073094 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-09d8221b-cfad-49ae-9e6e-22d0d29a2c2a tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:21.073821 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-09d8221b-cfad-49ae-9e6e-22d0d29a2c2a tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:21.123232 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-6861661c-8edd-47ea-b5ca-d514981f51f6 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:21.129814 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-6861661c-8edd-47ea-b5ca-d514981f51f6 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b" status: 200 len: 1097 microversion: 2.1 time: 0.078546 Feb 16 14:36:21.130392 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 533/1127] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:21 2022] GET /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b => generated 1097 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:36:21.236123 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-09d8221b-cfad-49ae-9e6e-22d0d29a2c2a tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:21.243823 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-09d8221b-cfad-49ae-9e6e-22d0d29a2c2a tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1578 microversion: 2.1 time: 0.183196 Feb 16 14:36:21.244508 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 595/1128] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:21 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1578 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:36:22.146865 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-eb132146-9276-4f71-a8be-f4201effdf53 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:22.147464 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-eb132146-9276-4f71-a8be-f4201effdf53 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: d3a6e4c8-bb6c-4d45-ad56-199bb833367b] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:22.154394 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-eb132146-9276-4f71-a8be-f4201effdf53 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:22.154864 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-eb132146-9276-4f71-a8be-f4201effdf53 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:22.155792 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-eb132146-9276-4f71-a8be-f4201effdf53 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:22.156229 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-eb132146-9276-4f71-a8be-f4201effdf53 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:22.216850 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-eb132146-9276-4f71-a8be-f4201effdf53 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:22.224554 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-eb132146-9276-4f71-a8be-f4201effdf53 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b" status: 200 len: 1147 microversion: 2.1 time: 0.081372 Feb 16 14:36:22.225124 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 534/1129] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:22 2022] GET /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b => generated 1147 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:36:22.266464 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-e03c4578-ea71-4197-93d2-da9db78f49fd tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:22.267161 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-e03c4578-ea71-4197-93d2-da9db78f49fd tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:22.275009 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e03c4578-ea71-4197-93d2-da9db78f49fd tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:22.283223 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e03c4578-ea71-4197-93d2-da9db78f49fd tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:22.283223 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e03c4578-ea71-4197-93d2-da9db78f49fd tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:22.283223 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e03c4578-ea71-4197-93d2-da9db78f49fd tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:22.425334 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-e03c4578-ea71-4197-93d2-da9db78f49fd tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:22.432883 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-e03c4578-ea71-4197-93d2-da9db78f49fd tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1578 microversion: 2.1 time: 0.171595 Feb 16 14:36:22.433449 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 596/1130] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:22 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1578 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:36:23.241155 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ec4accec-75c3-46f5-9ebe-32dc7741a80d tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:23.242436 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ec4accec-75c3-46f5-9ebe-32dc7741a80d tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: d3a6e4c8-bb6c-4d45-ad56-199bb833367b] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:23.249570 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ec4accec-75c3-46f5-9ebe-32dc7741a80d tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:23.250250 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ec4accec-75c3-46f5-9ebe-32dc7741a80d tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:23.251262 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ec4accec-75c3-46f5-9ebe-32dc7741a80d tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:23.251861 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ec4accec-75c3-46f5-9ebe-32dc7741a80d tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:23.321086 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ec4accec-75c3-46f5-9ebe-32dc7741a80d tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:23.329549 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ec4accec-75c3-46f5-9ebe-32dc7741a80d tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b" status: 200 len: 1213 microversion: 2.1 time: 0.092122 Feb 16 14:36:23.330126 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 535/1131] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:23 2022] GET /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:36:23.457610 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-9bc642da-9bff-4d7a-8005-50182c344554 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:23.458219 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-9bc642da-9bff-4d7a-8005-50182c344554 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:23.464272 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9bc642da-9bff-4d7a-8005-50182c344554 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:23.470052 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9bc642da-9bff-4d7a-8005-50182c344554 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:23.470052 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9bc642da-9bff-4d7a-8005-50182c344554 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:23.470052 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-9bc642da-9bff-4d7a-8005-50182c344554 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:23.632527 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-9bc642da-9bff-4d7a-8005-50182c344554 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:23.646812 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-9bc642da-9bff-4d7a-8005-50182c344554 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1578 microversion: 2.1 time: 0.193379 Feb 16 14:36:23.647410 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 597/1132] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:23 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1578 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:36:24.346850 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-1b3fbfce-9eba-449c-b68a-e4cbca216440 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:24.347397 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-1b3fbfce-9eba-449c-b68a-e4cbca216440 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: d3a6e4c8-bb6c-4d45-ad56-199bb833367b] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:24.353811 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1b3fbfce-9eba-449c-b68a-e4cbca216440 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:24.354273 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1b3fbfce-9eba-449c-b68a-e4cbca216440 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:24.355146 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1b3fbfce-9eba-449c-b68a-e4cbca216440 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:24.355589 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-1b3fbfce-9eba-449c-b68a-e4cbca216440 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:24.560255 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-1b3fbfce-9eba-449c-b68a-e4cbca216440 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:24.569590 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-1b3fbfce-9eba-449c-b68a-e4cbca216440 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b" status: 200 len: 1281 microversion: 2.1 time: 0.227133 Feb 16 14:36:24.570346 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 536/1133] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:24 2022] GET /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b => generated 1281 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:36:24.672309 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-e84123e9-a369-4b03-b296-83d331f41961 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:24.673106 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-e84123e9-a369-4b03-b296-83d331f41961 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:24.679203 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e84123e9-a369-4b03-b296-83d331f41961 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:24.684901 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e84123e9-a369-4b03-b296-83d331f41961 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:24.684901 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e84123e9-a369-4b03-b296-83d331f41961 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:24.684901 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-e84123e9-a369-4b03-b296-83d331f41961 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:24.822043 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-e84123e9-a369-4b03-b296-83d331f41961 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:24.833972 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-e84123e9-a369-4b03-b296-83d331f41961 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1578 microversion: 2.1 time: 0.171935 Feb 16 14:36:24.834715 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 598/1134] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:24 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1578 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:36:24.916842 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-66f6b03d-7de5-498c-a592-e2e651e53fa0 req-3587b9a7-4a6b-428d-b9be-82ccf8aa0483 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3a6e4c8-bb6c-4d45-ad56-199bb833367b", "tag": "d6c8233e-4946-4ceb-8a8d-10d4f42cec5d"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:36:24.918455 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:36:24.918455 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: warnings.warn(msg) Feb 16 14:36:24.925788 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-66f6b03d-7de5-498c-a592-e2e651e53fa0 req-3587b9a7-4a6b-428d-b9be-82ccf8aa0483 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:24.926245 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-66f6b03d-7de5-498c-a592-e2e651e53fa0 req-3587b9a7-4a6b-428d-b9be-82ccf8aa0483 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:24.937725 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-66f6b03d-7de5-498c-a592-e2e651e53fa0 req-3587b9a7-4a6b-428d-b9be-82ccf8aa0483 service nova] Creating event network-changed:d6c8233e-4946-4ceb-8a8d-10d4f42cec5d for instance d3a6e4c8-bb6c-4d45-ad56-199bb833367b on hv-cinder-80473 Feb 16 14:36:24.942727 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-66f6b03d-7de5-498c-a592-e2e651e53fa0 req-3587b9a7-4a6b-428d-b9be-82ccf8aa0483 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095883 Feb 16 14:36:24.943592 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 537/1135] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:36:25.586449 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-5ee4a71a-9aa4-429a-8bf9-9445c839f611 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:25.587096 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-5ee4a71a-9aa4-429a-8bf9-9445c839f611 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: d3a6e4c8-bb6c-4d45-ad56-199bb833367b] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:25.593612 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5ee4a71a-9aa4-429a-8bf9-9445c839f611 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:25.594059 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5ee4a71a-9aa4-429a-8bf9-9445c839f611 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:25.594892 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5ee4a71a-9aa4-429a-8bf9-9445c839f611 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:25.595327 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5ee4a71a-9aa4-429a-8bf9-9445c839f611 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:25.732867 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-5ee4a71a-9aa4-429a-8bf9-9445c839f611 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:25.740274 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-5ee4a71a-9aa4-429a-8bf9-9445c839f611 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b" status: 200 len: 1269 microversion: 2.1 time: 0.157522 Feb 16 14:36:25.740846 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 599/1136] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:25 2022] GET /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b => generated 1269 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:36:25.853304 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-d3848b40-23f2-416e-af2a-da644782f18f tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:25.854040 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-d3848b40-23f2-416e-af2a-da644782f18f tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:25.860080 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d3848b40-23f2-416e-af2a-da644782f18f tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:25.860528 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d3848b40-23f2-416e-af2a-da644782f18f tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:25.861317 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d3848b40-23f2-416e-af2a-da644782f18f tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:25.861750 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d3848b40-23f2-416e-af2a-da644782f18f tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:26.309771 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d3848b40-23f2-416e-af2a-da644782f18f tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:26.318465 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-d3848b40-23f2-416e-af2a-da644782f18f tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1578 microversion: 2.1 time: 0.469643 Feb 16 14:36:26.319126 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 538/1137] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:25 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1578 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:36:26.757621 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-ab3a60be-e224-4c84-a043-30ae0e470b2c tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:26.758161 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-ab3a60be-e224-4c84-a043-30ae0e470b2c tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: d3a6e4c8-bb6c-4d45-ad56-199bb833367b] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:26.764617 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ab3a60be-e224-4c84-a043-30ae0e470b2c tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:26.765240 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ab3a60be-e224-4c84-a043-30ae0e470b2c tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:26.766015 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ab3a60be-e224-4c84-a043-30ae0e470b2c tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:26.766444 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ab3a60be-e224-4c84-a043-30ae0e470b2c tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:26.897692 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-ab3a60be-e224-4c84-a043-30ae0e470b2c tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:26.905102 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-ab3a60be-e224-4c84-a043-30ae0e470b2c tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b" status: 200 len: 1269 microversion: 2.1 time: 0.151386 Feb 16 14:36:26.906232 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 600/1138] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:26 2022] GET /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b => generated 1269 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:36:27.338811 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-52dd3a87-e951-454d-bfbf-1485443353ab tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:27.339418 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-52dd3a87-e951-454d-bfbf-1485443353ab tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:27.346377 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-52dd3a87-e951-454d-bfbf-1485443353ab tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:27.346853 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-52dd3a87-e951-454d-bfbf-1485443353ab tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:27.347641 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-52dd3a87-e951-454d-bfbf-1485443353ab tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:27.348077 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-52dd3a87-e951-454d-bfbf-1485443353ab tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:27.480748 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-52dd3a87-e951-454d-bfbf-1485443353ab tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:27.488198 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-52dd3a87-e951-454d-bfbf-1485443353ab tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1578 microversion: 2.1 time: 0.153046 Feb 16 14:36:27.488773 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 539/1139] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:27 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:36:27.923405 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-91fe0629-a807-4602-a655-c12821ca170d tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:27.924023 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-91fe0629-a807-4602-a655-c12821ca170d tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: d3a6e4c8-bb6c-4d45-ad56-199bb833367b] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:27.930137 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-91fe0629-a807-4602-a655-c12821ca170d tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:27.931119 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-91fe0629-a807-4602-a655-c12821ca170d tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:27.931916 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-91fe0629-a807-4602-a655-c12821ca170d tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:27.932347 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-91fe0629-a807-4602-a655-c12821ca170d tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:28.066906 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-91fe0629-a807-4602-a655-c12821ca170d tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:28.074389 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-91fe0629-a807-4602-a655-c12821ca170d tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b" status: 200 len: 1269 microversion: 2.1 time: 0.156047 Feb 16 14:36:28.074994 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 601/1140] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:27 2022] GET /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b => generated 1269 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:36:28.508608 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-9d6bb3f8-4784-40e5-ad64-a280c477ae83 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:28.509307 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-9d6bb3f8-4784-40e5-ad64-a280c477ae83 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:28.516970 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9d6bb3f8-4784-40e5-ad64-a280c477ae83 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:28.517438 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9d6bb3f8-4784-40e5-ad64-a280c477ae83 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:28.518230 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9d6bb3f8-4784-40e5-ad64-a280c477ae83 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:28.518716 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-9d6bb3f8-4784-40e5-ad64-a280c477ae83 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:28.657355 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-9d6bb3f8-4784-40e5-ad64-a280c477ae83 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:28.665664 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-9d6bb3f8-4784-40e5-ad64-a280c477ae83 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1578 microversion: 2.1 time: 0.162671 Feb 16 14:36:28.666503 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 540/1141] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:28 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:36:29.091697 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-395142bc-7d44-4ecb-823a-7ff9400f1238 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:29.092332 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-395142bc-7d44-4ecb-823a-7ff9400f1238 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: d3a6e4c8-bb6c-4d45-ad56-199bb833367b] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:29.098864 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-395142bc-7d44-4ecb-823a-7ff9400f1238 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:29.099328 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-395142bc-7d44-4ecb-823a-7ff9400f1238 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:29.100109 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-395142bc-7d44-4ecb-823a-7ff9400f1238 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:29.100551 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-395142bc-7d44-4ecb-823a-7ff9400f1238 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:29.240813 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-395142bc-7d44-4ecb-823a-7ff9400f1238 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:29.248133 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-395142bc-7d44-4ecb-823a-7ff9400f1238 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b" status: 200 len: 1269 microversion: 2.1 time: 0.160123 Feb 16 14:36:29.248711 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 602/1142] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:29 2022] GET /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:36:29.683193 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-0c8b2430-3c66-49a9-b60d-6411fc405832 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:29.683741 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-0c8b2430-3c66-49a9-b60d-6411fc405832 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:29.690793 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0c8b2430-3c66-49a9-b60d-6411fc405832 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:29.691259 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0c8b2430-3c66-49a9-b60d-6411fc405832 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:29.692115 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0c8b2430-3c66-49a9-b60d-6411fc405832 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:29.692566 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0c8b2430-3c66-49a9-b60d-6411fc405832 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:29.888431 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-0c8b2430-3c66-49a9-b60d-6411fc405832 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:29.896492 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-0c8b2430-3c66-49a9-b60d-6411fc405832 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1578 microversion: 2.1 time: 0.216960 Feb 16 14:36:29.897073 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 541/1143] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:29 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1578 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:36:30.267133 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-68f218ec-3832-438d-9474-6c921ef76c1d tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:30.267754 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-68f218ec-3832-438d-9474-6c921ef76c1d tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: d3a6e4c8-bb6c-4d45-ad56-199bb833367b] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:30.274095 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-68f218ec-3832-438d-9474-6c921ef76c1d tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:30.274570 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-68f218ec-3832-438d-9474-6c921ef76c1d tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:30.275391 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-68f218ec-3832-438d-9474-6c921ef76c1d tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:30.275894 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-68f218ec-3832-438d-9474-6c921ef76c1d tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:30.409758 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-68f218ec-3832-438d-9474-6c921ef76c1d tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:30.417172 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-68f218ec-3832-438d-9474-6c921ef76c1d tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b" status: 200 len: 1269 microversion: 2.1 time: 0.155925 Feb 16 14:36:30.417737 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 603/1144] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:30 2022] GET /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b => generated 1269 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:36:30.913139 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-75c111b5-20bf-4139-8a2c-f9ebe794738e tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:30.913751 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-75c111b5-20bf-4139-8a2c-f9ebe794738e tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:30.920116 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-75c111b5-20bf-4139-8a2c-f9ebe794738e tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:30.920572 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-75c111b5-20bf-4139-8a2c-f9ebe794738e tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:30.922153 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-75c111b5-20bf-4139-8a2c-f9ebe794738e tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:30.922609 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-75c111b5-20bf-4139-8a2c-f9ebe794738e tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:31.062201 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-75c111b5-20bf-4139-8a2c-f9ebe794738e tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:31.069558 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-75c111b5-20bf-4139-8a2c-f9ebe794738e tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1578 microversion: 2.1 time: 0.160167 Feb 16 14:36:31.070128 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 542/1145] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:30 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:36:31.416484 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-3d5d2017-bcb1-4cbe-9867-c92cfaf9f1de req-5a512709-9d53-471e-b9bc-4f2c1bc12580 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c27f46dc-b073-4643-aecd-9706f8a2bd6a", "name": "network-vif-plugged", "status": "completed", "tag": "ed3741ec-f06d-46ec-8c0b-7eba0140cb02"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:36:31.417971 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:36:31.417971 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:36:31.426101 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-3d5d2017-bcb1-4cbe-9867-c92cfaf9f1de req-5a512709-9d53-471e-b9bc-4f2c1bc12580 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:31.426543 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-3d5d2017-bcb1-4cbe-9867-c92cfaf9f1de req-5a512709-9d53-471e-b9bc-4f2c1bc12580 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:31.433619 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ebae1929-9b8c-4d5f-b8f9-408e5c9e68ce tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:31.437314 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ebae1929-9b8c-4d5f-b8f9-408e5c9e68ce tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: d3a6e4c8-bb6c-4d45-ad56-199bb833367b] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:31.437856 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-3d5d2017-bcb1-4cbe-9867-c92cfaf9f1de req-5a512709-9d53-471e-b9bc-4f2c1bc12580 service nova] Creating event network-vif-plugged:ed3741ec-f06d-46ec-8c0b-7eba0140cb02 for instance c27f46dc-b073-4643-aecd-9706f8a2bd6a on hv-cinder-80473 Feb 16 14:36:31.440465 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ebae1929-9b8c-4d5f-b8f9-408e5c9e68ce tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:31.440921 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ebae1929-9b8c-4d5f-b8f9-408e5c9e68ce tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:31.441711 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ebae1929-9b8c-4d5f-b8f9-408e5c9e68ce tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:31.442198 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ebae1929-9b8c-4d5f-b8f9-408e5c9e68ce tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:31.443752 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-3d5d2017-bcb1-4cbe-9867-c92cfaf9f1de req-5a512709-9d53-471e-b9bc-4f2c1bc12580 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030597 Feb 16 14:36:31.444509 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 604/1146] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:36:31.587905 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-ebae1929-9b8c-4d5f-b8f9-408e5c9e68ce tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:31.596125 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ebae1929-9b8c-4d5f-b8f9-408e5c9e68ce tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b" status: 200 len: 1269 microversion: 2.1 time: 0.166810 Feb 16 14:36:31.596715 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 543/1147] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:31 2022] GET /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b => generated 1269 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:36:32.087261 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-39644c46-5131-49f3-834e-9ff93407056a tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:32.087884 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-39644c46-5131-49f3-834e-9ff93407056a tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:32.094782 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-39644c46-5131-49f3-834e-9ff93407056a tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:32.095240 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-39644c46-5131-49f3-834e-9ff93407056a tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:32.097340 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-39644c46-5131-49f3-834e-9ff93407056a tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:32.097340 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-39644c46-5131-49f3-834e-9ff93407056a tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:32.235667 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-39644c46-5131-49f3-834e-9ff93407056a tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:32.243024 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-39644c46-5131-49f3-834e-9ff93407056a tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1578 microversion: 2.1 time: 0.159972 Feb 16 14:36:32.243591 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 605/1148] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:32 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:36:32.612875 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-0f154ff1-ec01-4d7d-aa2d-eecae15d815c tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:32.613513 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-0f154ff1-ec01-4d7d-aa2d-eecae15d815c tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: d3a6e4c8-bb6c-4d45-ad56-199bb833367b] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:32.620068 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0f154ff1-ec01-4d7d-aa2d-eecae15d815c tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:32.620603 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0f154ff1-ec01-4d7d-aa2d-eecae15d815c tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:32.621405 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0f154ff1-ec01-4d7d-aa2d-eecae15d815c tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:32.621878 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-0f154ff1-ec01-4d7d-aa2d-eecae15d815c tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:32.760789 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-0f154ff1-ec01-4d7d-aa2d-eecae15d815c tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:32.770674 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-0f154ff1-ec01-4d7d-aa2d-eecae15d815c tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b" status: 200 len: 1269 microversion: 2.1 time: 0.161247 Feb 16 14:36:32.771496 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 544/1149] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:32 2022] GET /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b => generated 1269 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:36:33.259825 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-76e24c23-da05-45e7-bba0-863081138960 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:33.260426 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-76e24c23-da05-45e7-bba0-863081138960 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:33.267562 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-76e24c23-da05-45e7-bba0-863081138960 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:33.268019 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-76e24c23-da05-45e7-bba0-863081138960 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:33.268810 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-76e24c23-da05-45e7-bba0-863081138960 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:33.269251 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-76e24c23-da05-45e7-bba0-863081138960 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:33.406927 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-76e24c23-da05-45e7-bba0-863081138960 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:33.414578 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-76e24c23-da05-45e7-bba0-863081138960 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1565 microversion: 2.1 time: 0.158360 Feb 16 14:36:33.415184 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 606/1150] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:33 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:36:33.787580 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-d7682900-6ba5-49b8-88dd-0c15d4460716 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:33.788195 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-d7682900-6ba5-49b8-88dd-0c15d4460716 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: d3a6e4c8-bb6c-4d45-ad56-199bb833367b] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:33.794551 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d7682900-6ba5-49b8-88dd-0c15d4460716 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:33.794999 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d7682900-6ba5-49b8-88dd-0c15d4460716 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:33.796312 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d7682900-6ba5-49b8-88dd-0c15d4460716 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:33.797097 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d7682900-6ba5-49b8-88dd-0c15d4460716 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:33.937316 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d7682900-6ba5-49b8-88dd-0c15d4460716 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:33.945378 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-d7682900-6ba5-49b8-88dd-0c15d4460716 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b" status: 200 len: 1269 microversion: 2.1 time: 0.161497 Feb 16 14:36:33.946149 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 545/1151] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:33 2022] GET /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b => generated 1269 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:36:34.962984 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-5b708047-96bf-4667-af83-933c06a7034c tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:34.963603 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-5b708047-96bf-4667-af83-933c06a7034c tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: d3a6e4c8-bb6c-4d45-ad56-199bb833367b] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:34.970542 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5b708047-96bf-4667-af83-933c06a7034c tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:34.971026 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5b708047-96bf-4667-af83-933c06a7034c tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:34.971814 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5b708047-96bf-4667-af83-933c06a7034c tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:34.972256 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5b708047-96bf-4667-af83-933c06a7034c tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:35.103319 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-5b708047-96bf-4667-af83-933c06a7034c tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:35.111245 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-5b708047-96bf-4667-af83-933c06a7034c tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b" status: 200 len: 1269 microversion: 2.1 time: 0.151895 Feb 16 14:36:35.111819 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 607/1152] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:34 2022] GET /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b => generated 1269 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:36:35.482679 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-8794e871-8999-4bcd-a749-34a5d43f909a req-229a17c3-404b-4a0e-a3a6-bae2aadb1f45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3a6e4c8-bb6c-4d45-ad56-199bb833367b", "name": "network-vif-plugged", "status": "completed", "tag": "d6c8233e-4946-4ceb-8a8d-10d4f42cec5d"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:36:35.484763 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:36:35.484763 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: warnings.warn(msg) Feb 16 14:36:35.492291 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-8794e871-8999-4bcd-a749-34a5d43f909a req-229a17c3-404b-4a0e-a3a6-bae2aadb1f45 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:35.492861 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-8794e871-8999-4bcd-a749-34a5d43f909a req-229a17c3-404b-4a0e-a3a6-bae2aadb1f45 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:35.504955 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-8794e871-8999-4bcd-a749-34a5d43f909a req-229a17c3-404b-4a0e-a3a6-bae2aadb1f45 service nova] Creating event network-vif-plugged:d6c8233e-4946-4ceb-8a8d-10d4f42cec5d for instance d3a6e4c8-bb6c-4d45-ad56-199bb833367b on hv-cinder-80473 Feb 16 14:36:35.510024 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-8794e871-8999-4bcd-a749-34a5d43f909a req-229a17c3-404b-4a0e-a3a6-bae2aadb1f45 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031165 Feb 16 14:36:35.510617 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 546/1153] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 14:36:36.128299 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-baf4ae99-0e36-4f3f-9994-ffdd3dbcf7b6 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:36.128949 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-baf4ae99-0e36-4f3f-9994-ffdd3dbcf7b6 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: d3a6e4c8-bb6c-4d45-ad56-199bb833367b] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:36.135251 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-baf4ae99-0e36-4f3f-9994-ffdd3dbcf7b6 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:36.135695 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-baf4ae99-0e36-4f3f-9994-ffdd3dbcf7b6 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:36.136464 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-baf4ae99-0e36-4f3f-9994-ffdd3dbcf7b6 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:36.136897 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-baf4ae99-0e36-4f3f-9994-ffdd3dbcf7b6 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:36.272061 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-baf4ae99-0e36-4f3f-9994-ffdd3dbcf7b6 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:36.279363 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-baf4ae99-0e36-4f3f-9994-ffdd3dbcf7b6 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b" status: 200 len: 1269 microversion: 2.1 time: 0.155482 Feb 16 14:36:36.279967 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 608/1154] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:36 2022] GET /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b => generated 1269 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:36:37.297917 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e0356e18-675a-46b8-9fa1-8ec8cdd07e5d tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:37.298610 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-e0356e18-675a-46b8-9fa1-8ec8cdd07e5d tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: d3a6e4c8-bb6c-4d45-ad56-199bb833367b] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:37.304744 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e0356e18-675a-46b8-9fa1-8ec8cdd07e5d tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:37.305185 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e0356e18-675a-46b8-9fa1-8ec8cdd07e5d tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:37.305958 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e0356e18-675a-46b8-9fa1-8ec8cdd07e5d tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:37.306391 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e0356e18-675a-46b8-9fa1-8ec8cdd07e5d tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:37.440242 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-e0356e18-675a-46b8-9fa1-8ec8cdd07e5d tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:37.447657 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-e0356e18-675a-46b8-9fa1-8ec8cdd07e5d tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b" status: 200 len: 1455 microversion: 2.1 time: 0.154329 Feb 16 14:36:37.448486 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 547/1155] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:37 2022] GET /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b => generated 1455 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:36:37.464401 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-a444f26d-7704-40a1-98ab-65d79028e4a4 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:36:37.465015 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-a444f26d-7704-40a1-98ab-65d79028e4a4 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: d3a6e4c8-bb6c-4d45-ad56-199bb833367b] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:36:37.471602 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a444f26d-7704-40a1-98ab-65d79028e4a4 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:37.472055 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a444f26d-7704-40a1-98ab-65d79028e4a4 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:37.472835 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a444f26d-7704-40a1-98ab-65d79028e4a4 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:37.473274 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a444f26d-7704-40a1-98ab-65d79028e4a4 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:37.605368 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-a444f26d-7704-40a1-98ab-65d79028e4a4 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:36:37.613158 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-a444f26d-7704-40a1-98ab-65d79028e4a4 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b" status: 200 len: 1455 microversion: 2.1 time: 0.152364 Feb 16 14:36:37.613716 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 609/1156] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:36:37 2022] GET /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b => generated 1455 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:36:39.537841 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-96abe632-7fc7-42d2-b082-205c916d539a req-ee92f0e6-32bf-482c-9473-78ff74518a0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3a6e4c8-bb6c-4d45-ad56-199bb833367b", "tag": "d6c8233e-4946-4ceb-8a8d-10d4f42cec5d"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:36:39.539584 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:36:39.539584 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: warnings.warn(msg) Feb 16 14:36:39.547396 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-96abe632-7fc7-42d2-b082-205c916d539a req-ee92f0e6-32bf-482c-9473-78ff74518a0a service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:36:39.547919 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-96abe632-7fc7-42d2-b082-205c916d539a req-ee92f0e6-32bf-482c-9473-78ff74518a0a service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:36:39.558821 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-96abe632-7fc7-42d2-b082-205c916d539a req-ee92f0e6-32bf-482c-9473-78ff74518a0a service nova] Creating event network-changed:d6c8233e-4946-4ceb-8a8d-10d4f42cec5d for instance d3a6e4c8-bb6c-4d45-ad56-199bb833367b on hv-cinder-80473 Feb 16 14:36:39.564404 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-96abe632-7fc7-42d2-b082-205c916d539a req-ee92f0e6-32bf-482c-9473-78ff74518a0a service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030335 Feb 16 14:36:39.565219 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 548/1157] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:37:49.856523 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-f9f6fd9e-7441-4d6d-a65e-d694dc53ae44 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:37:49.857174 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-f9f6fd9e-7441-4d6d-a65e-d694dc53ae44 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:37:49.863643 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f9f6fd9e-7441-4d6d-a65e-d694dc53ae44 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:37:49.864414 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f9f6fd9e-7441-4d6d-a65e-d694dc53ae44 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:37:49.865429 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f9f6fd9e-7441-4d6d-a65e-d694dc53ae44 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:37:49.866065 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-f9f6fd9e-7441-4d6d-a65e-d694dc53ae44 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:37:49.904812 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-f9f6fd9e-7441-4d6d-a65e-d694dc53ae44 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Going to try to terminate instance {{(pid=117031) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 16 14:37:49.994862 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-52d6b7f0-245a-490f-9350-0702d91d9d14 req-d32d0b3b-5b69-467b-b321-23db892c279d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c27f46dc-b073-4643-aecd-9706f8a2bd6a", "tag": "ed3741ec-f06d-46ec-8c0b-7eba0140cb02"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:37:49.996633 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:37:49.996633 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: warnings.warn(msg) Feb 16 14:37:50.004413 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-52d6b7f0-245a-490f-9350-0702d91d9d14 req-d32d0b3b-5b69-467b-b321-23db892c279d service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:37:50.004984 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-52d6b7f0-245a-490f-9350-0702d91d9d14 req-d32d0b3b-5b69-467b-b321-23db892c279d service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:37:50.017379 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-52d6b7f0-245a-490f-9350-0702d91d9d14 req-d32d0b3b-5b69-467b-b321-23db892c279d service nova] Creating event network-changed:ed3741ec-f06d-46ec-8c0b-7eba0140cb02 for instance c27f46dc-b073-4643-aecd-9706f8a2bd6a on hv-cinder-80473 Feb 16 14:37:50.022907 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-52d6b7f0-245a-490f-9350-0702d91d9d14 req-d32d0b3b-5b69-467b-b321-23db892c279d service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162042 Feb 16 14:37:50.023837 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 549/1158] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:37:50.254921 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-f9f6fd9e-7441-4d6d-a65e-d694dc53ae44 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "DELETE /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 204 len: 0 microversion: 2.1 time: 0.399280 Feb 16 14:37:50.254921 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 610/1159] 10.222.0.110 () {58 vars in 1243 bytes} [Wed Feb 16 14:37:49 2022] DELETE /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 16 14:37:50.262211 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-d5a9caa8-1cd5-4daa-9565-7f654b4f56c4 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:37:50.262955 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-d5a9caa8-1cd5-4daa-9565-7f654b4f56c4 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:37:50.269130 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d5a9caa8-1cd5-4daa-9565-7f654b4f56c4 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:37:50.269581 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d5a9caa8-1cd5-4daa-9565-7f654b4f56c4 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:37:50.270412 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d5a9caa8-1cd5-4daa-9565-7f654b4f56c4 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:37:50.270966 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-d5a9caa8-1cd5-4daa-9565-7f654b4f56c4 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:37:50.496133 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-d5a9caa8-1cd5-4daa-9565-7f654b4f56c4 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:37:50.503984 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-d5a9caa8-1cd5-4daa-9565-7f654b4f56c4 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1571 microversion: 2.1 time: 0.246544 Feb 16 14:37:50.504698 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 550/1160] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:37:50 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1571 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:37:51.521743 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-34f35338-0b0f-4372-a4c7-39f66fe2df2a tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:37:51.522436 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-34f35338-0b0f-4372-a4c7-39f66fe2df2a tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:37:51.529381 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-34f35338-0b0f-4372-a4c7-39f66fe2df2a tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:37:51.529830 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-34f35338-0b0f-4372-a4c7-39f66fe2df2a tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:37:51.530668 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-34f35338-0b0f-4372-a4c7-39f66fe2df2a tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:37:51.531106 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-34f35338-0b0f-4372-a4c7-39f66fe2df2a tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:37:51.669986 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-34f35338-0b0f-4372-a4c7-39f66fe2df2a tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:37:51.677288 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-34f35338-0b0f-4372-a4c7-39f66fe2df2a tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1453 microversion: 2.1 time: 0.159656 Feb 16 14:37:51.677856 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 611/1161] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:37:51 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:37:52.497505 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-67e22639-07cf-420f-b2f7-3c43c215a361 req-43e04713-8562-4d8a-ba61-8c6827ee5ca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c27f46dc-b073-4643-aecd-9706f8a2bd6a", "name": "network-vif-deleted", "tag": "ed3741ec-f06d-46ec-8c0b-7eba0140cb02"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:37:52.499078 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:37:52.499078 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: warnings.warn(msg) Feb 16 14:37:52.506393 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-67e22639-07cf-420f-b2f7-3c43c215a361 req-43e04713-8562-4d8a-ba61-8c6827ee5ca4 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:37:52.506883 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-67e22639-07cf-420f-b2f7-3c43c215a361 req-43e04713-8562-4d8a-ba61-8c6827ee5ca4 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:37:52.519873 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-67e22639-07cf-420f-b2f7-3c43c215a361 req-43e04713-8562-4d8a-ba61-8c6827ee5ca4 service nova] Creating event network-vif-deleted:ed3741ec-f06d-46ec-8c0b-7eba0140cb02 for instance c27f46dc-b073-4643-aecd-9706f8a2bd6a on hv-cinder-80473 Feb 16 14:37:52.524644 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-67e22639-07cf-420f-b2f7-3c43c215a361 req-43e04713-8562-4d8a-ba61-8c6827ee5ca4 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031639 Feb 16 14:37:52.525248 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 551/1162] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:37:52.694013 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-8848bf4f-1081-42a2-9a51-f439e539ee10 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:37:52.694676 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-8848bf4f-1081-42a2-9a51-f439e539ee10 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:37:52.701948 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8848bf4f-1081-42a2-9a51-f439e539ee10 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:37:52.702700 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8848bf4f-1081-42a2-9a51-f439e539ee10 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:37:52.703141 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8848bf4f-1081-42a2-9a51-f439e539ee10 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:37:52.703570 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-8848bf4f-1081-42a2-9a51-f439e539ee10 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:37:52.764329 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-8848bf4f-1081-42a2-9a51-f439e539ee10 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:37:52.772053 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-8848bf4f-1081-42a2-9a51-f439e539ee10 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1222 microversion: 2.1 time: 0.082009 Feb 16 14:37:52.772662 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 612/1163] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:37:52 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:37:53.790918 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-8c2c03d5-7358-4533-94dc-3da023c42862 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:37:53.791625 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-8c2c03d5-7358-4533-94dc-3da023c42862 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:37:53.798231 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8c2c03d5-7358-4533-94dc-3da023c42862 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:37:53.798728 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8c2c03d5-7358-4533-94dc-3da023c42862 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:37:53.799568 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8c2c03d5-7358-4533-94dc-3da023c42862 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:37:53.800031 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8c2c03d5-7358-4533-94dc-3da023c42862 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:37:53.831187 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8c2c03d5-7358-4533-94dc-3da023c42862 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:37:53.831789 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-8c2c03d5-7358-4533-94dc-3da023c42862 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:37:53.832247 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.objects.instance [None req-8c2c03d5-7358-4533-94dc-3da023c42862 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lazy-loading 'fault' on Instance uuid c27f46dc-b073-4643-aecd-9706f8a2bd6a {{(pid=117032) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:37:53.876104 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-8c2c03d5-7358-4533-94dc-3da023c42862 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb544a38285c485ba51e44991d1c4be2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b87af7cf2ef041d795d4b0f320e7b3b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:37:53.882647 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-8c2c03d5-7358-4533-94dc-3da023c42862 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 200 len: 1227 microversion: 2.1 time: 0.096904 Feb 16 14:37:53.883215 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 552/1164] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:37:53 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 1227 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:37:54.899826 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-db46e2ed-46d3-4150-a4db-72ea8dcbb553 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:37:54.900442 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-db46e2ed-46d3-4150-a4db-72ea8dcbb553 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [instance: c27f46dc-b073-4643-aecd-9706f8a2bd6a] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:37:54.907732 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-db46e2ed-46d3-4150-a4db-72ea8dcbb553 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:37:54.908186 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-db46e2ed-46d3-4150-a4db-72ea8dcbb553 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:37:54.908971 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-db46e2ed-46d3-4150-a4db-72ea8dcbb553 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:37:54.909408 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-db46e2ed-46d3-4150-a4db-72ea8dcbb553 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:37:54.922502 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.wsgi [None req-db46e2ed-46d3-4150-a4db-72ea8dcbb553 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] HTTP exception thrown: Instance c27f46dc-b073-4643-aecd-9706f8a2bd6a could not be found. Feb 16 14:37:54.923114 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-db46e2ed-46d3-4150-a4db-72ea8dcbb553 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Returning 404 to user: Instance c27f46dc-b073-4643-aecd-9706f8a2bd6a could not be found. {{(pid=117031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:37:54.923926 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-db46e2ed-46d3-4150-a4db-72ea8dcbb553 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a" status: 404 len: 111 microversion: 2.1 time: 0.027889 Feb 16 14:37:54.924446 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 613/1165] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:37:54 2022] GET /compute/v2.1/servers/c27f46dc-b073-4643-aecd-9706f8a2bd6a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 14:37:55.135162 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6057e8cd-9247-44eb-803f-ca8db6bc7ab5 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] Calling method '.version_select at 0x7f2990dfadc0>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:37:55.140068 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6057e8cd-9247-44eb-803f-ca8db6bc7ab5 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [1e5c7ae4-d6c1-44ff-ba63-0c3f96b3c359] AMQP server on 10.222.0.110:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Feb 16 14:37:56.149442 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO oslo.messaging._drivers.impl_rabbit [None req-6057e8cd-9247-44eb-803f-ca8db6bc7ab5 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] [1e5c7ae4-d6c1-44ff-ba63-0c3f96b3c359] Reconnected to AMQP server on 10.222.0.110:5672 via [amqp] client with port 53850. Feb 16 14:37:56.235554 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-6057e8cd-9247-44eb-803f-ca8db6bc7ab5 tempest-TestShelveInstance-880626411 tempest-TestShelveInstance-880626411-project] 10.222.0.110 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-617354267" status: 202 len: 0 microversion: 2.1 time: 1.104054 Feb 16 14:37:56.236021 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 553/1166] 10.222.0.110 () {58 vars in 1255 bytes} [Wed Feb 16 14:37:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-617354267 => generated 0 bytes in 1105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 14:38:07.635266 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-1a62fae6-6af7-46ec-8503-f14a73f5869f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:38:07.635758 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-1a62fae6-6af7-46ec-8503-f14a73f5869f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: d3a6e4c8-bb6c-4d45-ad56-199bb833367b] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:38:07.637235 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-32098254-e06b-4098-865e-c37067b7633e req-60728b93-6e14-4863-afd1-3ff7a7b5f5f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3a6e4c8-bb6c-4d45-ad56-199bb833367b", "tag": "d6c8233e-4946-4ceb-8a8d-10d4f42cec5d"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:38:07.639390 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:38:07.639390 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: warnings.warn(msg) Feb 16 14:38:07.642795 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1a62fae6-6af7-46ec-8503-f14a73f5869f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:38:07.643243 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1a62fae6-6af7-46ec-8503-f14a73f5869f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:38:07.644029 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1a62fae6-6af7-46ec-8503-f14a73f5869f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:38:07.644468 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-1a62fae6-6af7-46ec-8503-f14a73f5869f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:38:07.654329 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-32098254-e06b-4098-865e-c37067b7633e req-60728b93-6e14-4863-afd1-3ff7a7b5f5f8 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:38:07.659679 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-32098254-e06b-4098-865e-c37067b7633e req-60728b93-6e14-4863-afd1-3ff7a7b5f5f8 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:38:07.666525 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-32098254-e06b-4098-865e-c37067b7633e req-60728b93-6e14-4863-afd1-3ff7a7b5f5f8 service nova] Creating event network-changed:d6c8233e-4946-4ceb-8a8d-10d4f42cec5d for instance d3a6e4c8-bb6c-4d45-ad56-199bb833367b on hv-cinder-80473 Feb 16 14:38:07.672290 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-1a62fae6-6af7-46ec-8503-f14a73f5869f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: d3a6e4c8-bb6c-4d45-ad56-199bb833367b] Going to try to terminate instance {{(pid=117031) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 16 14:38:07.672441 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-32098254-e06b-4098-865e-c37067b7633e req-60728b93-6e14-4863-afd1-3ff7a7b5f5f8 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038696 Feb 16 14:38:07.672993 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 554/1167] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:38:07.993294 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-1a62fae6-6af7-46ec-8503-f14a73f5869f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "DELETE /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b" status: 204 len: 0 microversion: 2.1 time: 0.361511 Feb 16 14:38:07.994180 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 614/1168] 10.222.0.110 () {58 vars in 1243 bytes} [Wed Feb 16 14:38:07 2022] DELETE /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 16 14:38:08.003550 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e18436e1-98e7-47a8-9175-e3c12a234743 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:38:08.004613 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-e18436e1-98e7-47a8-9175-e3c12a234743 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: d3a6e4c8-bb6c-4d45-ad56-199bb833367b] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:38:08.011635 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e18436e1-98e7-47a8-9175-e3c12a234743 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:38:08.012369 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e18436e1-98e7-47a8-9175-e3c12a234743 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:38:08.013257 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e18436e1-98e7-47a8-9175-e3c12a234743 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:38:08.013969 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e18436e1-98e7-47a8-9175-e3c12a234743 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:38:08.266535 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-e18436e1-98e7-47a8-9175-e3c12a234743 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:38:08.279536 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-e18436e1-98e7-47a8-9175-e3c12a234743 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b" status: 200 len: 1579 microversion: 2.1 time: 0.275631 Feb 16 14:38:08.283517 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 555/1169] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:38:07 2022] GET /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b => generated 1579 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:38:09.292760 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-c66ff98d-e4c5-4427-b3fc-5f25693e3e21 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:38:09.293460 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-c66ff98d-e4c5-4427-b3fc-5f25693e3e21 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: d3a6e4c8-bb6c-4d45-ad56-199bb833367b] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:38:09.299770 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c66ff98d-e4c5-4427-b3fc-5f25693e3e21 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:38:09.300218 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c66ff98d-e4c5-4427-b3fc-5f25693e3e21 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:38:09.300994 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c66ff98d-e4c5-4427-b3fc-5f25693e3e21 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:38:09.301428 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-c66ff98d-e4c5-4427-b3fc-5f25693e3e21 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:38:09.447673 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-c66ff98d-e4c5-4427-b3fc-5f25693e3e21 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:38:09.456157 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-c66ff98d-e4c5-4427-b3fc-5f25693e3e21 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b" status: 200 len: 1461 microversion: 2.1 time: 0.167439 Feb 16 14:38:09.456725 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 615/1170] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:38:09 2022] GET /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b => generated 1461 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:38:10.474090 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-e0a4747d-0efe-438d-a71b-4d7e43487817 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:38:10.474756 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-e0a4747d-0efe-438d-a71b-4d7e43487817 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: d3a6e4c8-bb6c-4d45-ad56-199bb833367b] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:38:10.481495 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e0a4747d-0efe-438d-a71b-4d7e43487817 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:38:10.481969 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e0a4747d-0efe-438d-a71b-4d7e43487817 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:38:10.482795 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e0a4747d-0efe-438d-a71b-4d7e43487817 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:38:10.483301 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-e0a4747d-0efe-438d-a71b-4d7e43487817 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:38:10.515745 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [req-7b32ff16-fcbe-4ab0-b824-9b2c66fa1221 req-a28619c8-5bf5-4b45-9143-44604965a9ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3a6e4c8-bb6c-4d45-ad56-199bb833367b", "name": "network-vif-deleted", "tag": "d6c8233e-4946-4ceb-8a8d-10d4f42cec5d"}]} {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:38:10.517268 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:38:10.517268 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: warnings.warn(msg) Feb 16 14:38:10.524562 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-7b32ff16-fcbe-4ab0-b824-9b2c66fa1221 req-a28619c8-5bf5-4b45-9143-44604965a9ac service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:38:10.524995 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [req-7b32ff16-fcbe-4ab0-b824-9b2c66fa1221 req-a28619c8-5bf5-4b45-9143-44604965a9ac service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:38:10.538536 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.compute.server_external_events [req-7b32ff16-fcbe-4ab0-b824-9b2c66fa1221 req-a28619c8-5bf5-4b45-9143-44604965a9ac service nova] Creating event network-vif-deleted:d6c8233e-4946-4ceb-8a8d-10d4f42cec5d for instance d3a6e4c8-bb6c-4d45-ad56-199bb833367b on hv-cinder-80473 Feb 16 14:38:10.543526 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [req-7b32ff16-fcbe-4ab0-b824-9b2c66fa1221 req-a28619c8-5bf5-4b45-9143-44604965a9ac service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031953 Feb 16 14:38:10.544120 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 616/1171] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Feb 16 14:38:10.558243 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-e0a4747d-0efe-438d-a71b-4d7e43487817 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:38:10.563989 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-e0a4747d-0efe-438d-a71b-4d7e43487817 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b" status: 200 len: 1393 microversion: 2.1 time: 0.094271 Feb 16 14:38:10.564553 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 556/1172] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:38:10 2022] GET /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b => generated 1393 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:38:11.583025 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-5b49ba8a-d9b9-43a1-9882-b87b3dcc7253 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:38:11.583754 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-5b49ba8a-d9b9-43a1-9882-b87b3dcc7253 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: d3a6e4c8-bb6c-4d45-ad56-199bb833367b] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:38:11.589778 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5b49ba8a-d9b9-43a1-9882-b87b3dcc7253 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:38:11.590489 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5b49ba8a-d9b9-43a1-9882-b87b3dcc7253 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:38:11.591099 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5b49ba8a-d9b9-43a1-9882-b87b3dcc7253 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:38:11.591533 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5b49ba8a-d9b9-43a1-9882-b87b3dcc7253 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:38:11.622461 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5b49ba8a-d9b9-43a1-9882-b87b3dcc7253 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:38:11.622939 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-5b49ba8a-d9b9-43a1-9882-b87b3dcc7253 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:38:11.623384 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.objects.instance [None req-5b49ba8a-d9b9-43a1-9882-b87b3dcc7253 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lazy-loading 'fault' on Instance uuid d3a6e4c8-bb6c-4d45-ad56-199bb833367b {{(pid=117031) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Feb 16 14:38:11.663294 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-5b49ba8a-d9b9-43a1-9882-b87b3dcc7253 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:38:11.672942 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-5b49ba8a-d9b9-43a1-9882-b87b3dcc7253 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b" status: 200 len: 1233 microversion: 2.1 time: 0.094187 Feb 16 14:38:11.674675 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 617/1173] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:38:11 2022] GET /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b => generated 1233 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:38:12.690029 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-705d720e-0d21-4e04-9093-f1d587a42097 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:38:12.690660 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-705d720e-0d21-4e04-9093-f1d587a42097 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: d3a6e4c8-bb6c-4d45-ad56-199bb833367b] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:38:12.697233 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-705d720e-0d21-4e04-9093-f1d587a42097 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:38:12.697963 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-705d720e-0d21-4e04-9093-f1d587a42097 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:38:12.698474 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-705d720e-0d21-4e04-9093-f1d587a42097 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:38:12.698936 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-705d720e-0d21-4e04-9093-f1d587a42097 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:38:12.711947 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-705d720e-0d21-4e04-9093-f1d587a42097 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] HTTP exception thrown: Instance d3a6e4c8-bb6c-4d45-ad56-199bb833367b could not be found. Feb 16 14:38:12.712531 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-705d720e-0d21-4e04-9093-f1d587a42097 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Returning 404 to user: Instance d3a6e4c8-bb6c-4d45-ad56-199bb833367b could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:38:12.713348 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-705d720e-0d21-4e04-9093-f1d587a42097 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b" status: 404 len: 111 microversion: 2.1 time: 0.027689 Feb 16 14:38:12.713862 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 557/1174] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:38:12 2022] GET /compute/v2.1/servers/d3a6e4c8-bb6c-4d45-ad56-199bb833367b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 14:38:15.976465 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-ec3a8ccf-e23a-4f2c-923d-1f36f2b0f907 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:38:15.976973 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-ec3a8ccf-e23a-4f2c-923d-1f36f2b0f907 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: be436bc5-0a4e-4eb3-bea3-a921f56dd41c] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:38:15.979275 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-671db329-4bfa-485b-beda-19819f6873e9 req-60b10c96-a907-4eff-8354-6ff687a47e88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be436bc5-0a4e-4eb3-bea3-a921f56dd41c", "tag": "cb1eeeba-3f72-41f2-8ee0-e94ead41dcdb"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:38:15.980976 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:38:15.980976 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: warnings.warn(msg) Feb 16 14:38:15.985661 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ec3a8ccf-e23a-4f2c-923d-1f36f2b0f907 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:38:15.986322 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ec3a8ccf-e23a-4f2c-923d-1f36f2b0f907 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:38:15.987131 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ec3a8ccf-e23a-4f2c-923d-1f36f2b0f907 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:38:15.987560 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ec3a8ccf-e23a-4f2c-923d-1f36f2b0f907 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:38:15.989324 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-671db329-4bfa-485b-beda-19819f6873e9 req-60b10c96-a907-4eff-8354-6ff687a47e88 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:38:15.989867 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-671db329-4bfa-485b-beda-19819f6873e9 req-60b10c96-a907-4eff-8354-6ff687a47e88 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:38:16.002150 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-671db329-4bfa-485b-beda-19819f6873e9 req-60b10c96-a907-4eff-8354-6ff687a47e88 service nova] Creating event network-changed:cb1eeeba-3f72-41f2-8ee0-e94ead41dcdb for instance be436bc5-0a4e-4eb3-bea3-a921f56dd41c on hv-cinder-80473 Feb 16 14:38:16.007416 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-671db329-4bfa-485b-beda-19819f6873e9 req-60b10c96-a907-4eff-8354-6ff687a47e88 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031900 Feb 16 14:38:16.008108 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 558/1175] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:38:16.014544 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-ec3a8ccf-e23a-4f2c-923d-1f36f2b0f907 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: be436bc5-0a4e-4eb3-bea3-a921f56dd41c] Going to try to terminate instance {{(pid=117031) delete /opt/stack/nova/nova/compute/api.py:2614}} Feb 16 14:38:16.284650 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-ec3a8ccf-e23a-4f2c-923d-1f36f2b0f907 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "DELETE /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c" status: 204 len: 0 microversion: 2.1 time: 0.311369 Feb 16 14:38:16.285244 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 618/1176] 10.222.0.110 () {58 vars in 1243 bytes} [Wed Feb 16 14:38:15 2022] DELETE /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Feb 16 14:38:16.304768 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-24d2c8e6-2d1b-4755-bb65-b2a5a7445177 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:38:16.305570 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-24d2c8e6-2d1b-4755-bb65-b2a5a7445177 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: be436bc5-0a4e-4eb3-bea3-a921f56dd41c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:38:16.311779 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-24d2c8e6-2d1b-4755-bb65-b2a5a7445177 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:38:16.312228 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-24d2c8e6-2d1b-4755-bb65-b2a5a7445177 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:38:16.313019 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-24d2c8e6-2d1b-4755-bb65-b2a5a7445177 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:38:16.313465 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-24d2c8e6-2d1b-4755-bb65-b2a5a7445177 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:38:16.558334 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.policy [None req-24d2c8e6-2d1b-4755-bb65-b2a5a7445177 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117032) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:38:16.566078 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-24d2c8e6-2d1b-4755-bb65-b2a5a7445177 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c" status: 200 len: 1579 microversion: 2.1 time: 0.265362 Feb 16 14:38:16.566668 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 559/1177] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:38:16 2022] GET /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c => generated 1579 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Feb 16 14:38:17.583915 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-89c0149d-b4a2-4d49-b12f-0956079e04b6 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:38:17.584616 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-89c0149d-b4a2-4d49-b12f-0956079e04b6 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: be436bc5-0a4e-4eb3-bea3-a921f56dd41c] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:38:17.590907 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-89c0149d-b4a2-4d49-b12f-0956079e04b6 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:38:17.591360 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-89c0149d-b4a2-4d49-b12f-0956079e04b6 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:38:17.592130 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-89c0149d-b4a2-4d49-b12f-0956079e04b6 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:38:17.593087 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-89c0149d-b4a2-4d49-b12f-0956079e04b6 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:38:17.724491 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-89c0149d-b4a2-4d49-b12f-0956079e04b6 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:38:17.731731 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-89c0149d-b4a2-4d49-b12f-0956079e04b6 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c" status: 200 len: 1461 microversion: 2.1 time: 0.151872 Feb 16 14:38:17.732290 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 619/1178] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:38:17 2022] GET /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c => generated 1461 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:38:18.557556 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [req-9dcebeea-914f-4e35-97b9-8e2a5539391a req-6113fa0c-5c67-4254-ad93-4becfbae48c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be436bc5-0a4e-4eb3-bea3-a921f56dd41c", "name": "network-vif-deleted", "tag": "cb1eeeba-3f72-41f2-8ee0-e94ead41dcdb"}]} {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Feb 16 14:38:18.559094 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 16 14:38:18.559094 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: warnings.warn(msg) Feb 16 14:38:18.566933 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-9dcebeea-914f-4e35-97b9-8e2a5539391a req-6113fa0c-5c67-4254-ad93-4becfbae48c8 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:38:18.567357 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [req-9dcebeea-914f-4e35-97b9-8e2a5539391a req-6113fa0c-5c67-4254-ad93-4becfbae48c8 service nova] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:38:18.579334 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.compute.server_external_events [req-9dcebeea-914f-4e35-97b9-8e2a5539391a req-6113fa0c-5c67-4254-ad93-4becfbae48c8 service nova] Creating event network-vif-deleted:cb1eeeba-3f72-41f2-8ee0-e94ead41dcdb for instance be436bc5-0a4e-4eb3-bea3-a921f56dd41c on hv-cinder-80473 Feb 16 14:38:18.584183 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [req-9dcebeea-914f-4e35-97b9-8e2a5539391a req-6113fa0c-5c67-4254-ad93-4becfbae48c8 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030296 Feb 16 14:38:18.584772 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 560/1179] 10.222.0.110 () {64 vars in 1322 bytes} [Wed Feb 16 14:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Feb 16 14:38:18.751148 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-ac7db291-0f8d-42e5-8bae-3ee4191b6791 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:38:18.757407 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-ac7db291-0f8d-42e5-8bae-3ee4191b6791 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: be436bc5-0a4e-4eb3-bea3-a921f56dd41c] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:38:18.759492 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ac7db291-0f8d-42e5-8bae-3ee4191b6791 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:38:18.760214 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ac7db291-0f8d-42e5-8bae-3ee4191b6791 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:38:18.761432 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ac7db291-0f8d-42e5-8bae-3ee4191b6791 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:38:18.762152 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-ac7db291-0f8d-42e5-8bae-3ee4191b6791 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:38:18.840123 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.policy [None req-ac7db291-0f8d-42e5-8bae-3ee4191b6791 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44f75877ea98492e95bfe67b250891e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a072f4cf28da4e14b3fd13b1ba2a9686', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117031) authorize /opt/stack/nova/nova/policy.py:199}} Feb 16 14:38:18.848128 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-ac7db291-0f8d-42e5-8bae-3ee4191b6791 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c" status: 200 len: 1228 microversion: 2.1 time: 0.102734 Feb 16 14:38:18.848707 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 620/1180] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:38:18 2022] GET /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c => generated 1228 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Feb 16 14:38:19.866133 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6661428b-8032-40b3-892a-7da9b0779cfb tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:38:19.866883 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-6661428b-8032-40b3-892a-7da9b0779cfb tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: be436bc5-0a4e-4eb3-bea3-a921f56dd41c] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:38:19.873076 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6661428b-8032-40b3-892a-7da9b0779cfb tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:38:19.873542 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6661428b-8032-40b3-892a-7da9b0779cfb tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:38:19.874492 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6661428b-8032-40b3-892a-7da9b0779cfb tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:38:19.874970 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-6661428b-8032-40b3-892a-7da9b0779cfb tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:38:19.889149 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-6661428b-8032-40b3-892a-7da9b0779cfb tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] HTTP exception thrown: Instance be436bc5-0a4e-4eb3-bea3-a921f56dd41c could not be found. Feb 16 14:38:19.889928 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-6661428b-8032-40b3-892a-7da9b0779cfb tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Returning 404 to user: Instance be436bc5-0a4e-4eb3-bea3-a921f56dd41c could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:38:19.890798 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-6661428b-8032-40b3-892a-7da9b0779cfb tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c" status: 404 len: 111 microversion: 2.1 time: 0.029182 Feb 16 14:38:19.891331 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 561/1181] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:38:19 2022] GET /compute/v2.1/servers/be436bc5-0a4e-4eb3-bea3-a921f56dd41c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 14:38:20.422885 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-a6a044a1-dc12-4739-a536-08633f508f3f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:38:20.423377 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.compute.api [None req-a6a044a1-dc12-4739-a536-08633f508f3f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: cc0fdcf7-b856-43f5-b061-b03d687c327f] Fetching instance by UUID {{(pid=117031) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:38:20.429450 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a6a044a1-dc12-4739-a536-08633f508f3f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:38:20.429905 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a6a044a1-dc12-4739-a536-08633f508f3f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:38:20.430785 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a6a044a1-dc12-4739-a536-08633f508f3f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:38:20.431479 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG oslo_concurrency.lockutils [None req-a6a044a1-dc12-4739-a536-08633f508f3f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:38:20.444826 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.wsgi [None req-a6a044a1-dc12-4739-a536-08633f508f3f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] HTTP exception thrown: Instance cc0fdcf7-b856-43f5-b061-b03d687c327f could not be found. Feb 16 14:38:20.445427 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-a6a044a1-dc12-4739-a536-08633f508f3f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Returning 404 to user: Instance cc0fdcf7-b856-43f5-b061-b03d687c327f could not be found. {{(pid=117031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:38:20.446252 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-a6a044a1-dc12-4739-a536-08633f508f3f tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "DELETE /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f" status: 404 len: 111 microversion: 2.1 time: 0.027090 Feb 16 14:38:20.447075 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 621/1182] 10.222.0.110 () {58 vars in 1243 bytes} [Wed Feb 16 14:38:20 2022] DELETE /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 14:38:20.455619 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ee150fee-04ce-4987-becc-855936805679 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '>' {{(pid=117032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:38:20.456248 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.compute.api [None req-ee150fee-04ce-4987-becc-855936805679 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] [instance: cc0fdcf7-b856-43f5-b061-b03d687c327f] Fetching instance by UUID {{(pid=117032) get /opt/stack/nova/nova/compute/api.py:2865}} Feb 16 14:38:20.462062 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ee150fee-04ce-4987-becc-855936805679 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:38:20.462514 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ee150fee-04ce-4987-becc-855936805679 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:38:20.463332 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ee150fee-04ce-4987-becc-855936805679 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 16 14:38:20.463771 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG oslo_concurrency.lockutils [None req-ee150fee-04ce-4987-becc-855936805679 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Lock "d50d195e-47a1-45e7-9830-39e8ce60e8f3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 16 14:38:20.477691 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.wsgi [None req-ee150fee-04ce-4987-becc-855936805679 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] HTTP exception thrown: Instance cc0fdcf7-b856-43f5-b061-b03d687c327f could not be found. Feb 16 14:38:20.478309 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: DEBUG nova.api.openstack.wsgi [None req-ee150fee-04ce-4987-becc-855936805679 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Returning 404 to user: Instance cc0fdcf7-b856-43f5-b061-b03d687c327f could not be found. {{(pid=117032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Feb 16 14:38:20.479174 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO nova.api.openstack.requestlog [None req-ee150fee-04ce-4987-becc-855936805679 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f" status: 404 len: 111 microversion: 2.1 time: 0.027889 Feb 16 14:38:20.479715 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: [pid: 117032|app: 0|req: 562/1183] 10.222.0.110 () {58 vars in 1240 bytes} [Wed Feb 16 14:38:20 2022] GET /compute/v2.1/servers/cc0fdcf7-b856-43f5-b061-b03d687c327f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Feb 16 14:38:21.963583 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: DEBUG nova.api.openstack.wsgi [None req-8df2066f-8928-4aaa-b196-d0e676c53199 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] Calling method '.version_select at 0x7f2990dcdca0>' {{(pid=117031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Feb 16 14:38:22.022442 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO nova.api.openstack.requestlog [None req-8df2066f-8928-4aaa-b196-d0e676c53199 tempest-TestVolumeBootPattern-108233702 tempest-TestVolumeBootPattern-108233702-project] 10.222.0.110 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-203474760" status: 202 len: 0 microversion: 2.1 time: 0.062444 Feb 16 14:38:22.023052 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: [pid: 117031|app: 0|req: 622/1184] 10.222.0.110 () {58 vars in 1264 bytes} [Wed Feb 16 14:38:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-203474760 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Feb 16 14:38:40.449398 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 16 14:38:40.449953 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: Wed Feb 16 14:38:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 16 14:39:00.853789 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 16 14:39:00.853789 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: Wed Feb 16 14:39:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 16 14:40:41.629094 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 16 14:40:41.629698 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: Wed Feb 16 14:40:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 16 14:40:44.910867 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 16 14:40:44.911585 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: Wed Feb 16 14:40:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 16 14:40:52.174457 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 16 14:40:52.175326 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: Wed Feb 16 14:40:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 16 14:42:00.457633 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 16 14:42:00.458154 dv-cinder-804735-16-iscsi devstack@n-api.service[117032]: Wed Feb 16 14:42:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Feb 16 14:42:20.861013 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Feb 16 14:42:20.861609 dv-cinder-804735-16-iscsi devstack@n-api.service[117031]: Wed Feb 16 14:42:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!